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SYNOPSIS 


The first formulation of the statistical infernce problems in 
the now-familiar "Ranking and Selection" framework was given by 
Bechhof er (1954) and Gupta <1956). Since the inception of this 
area of research a number of variations, modifications, 
and generalizations of the problem have been considered by many 
active researchers. 

Let Xj denote k < > 2 ) random variables representing 


popu lat l ons 

rij n 

k « respectively. Suppose that 

X. 

l 

has a 

probabi 1 i ty 

dens l ty 

function f^ <.;©.), where © ^ 

1 s 

a real 

parameter, i 

= 1 

k. Let ©j-j} 5 ... < denote 

the 

ranked 


values of ©^ © ^ , and let denote the population associated 

with the l-th smallest of ©^'s. It is assumed that there is 

no prior knowledge about which of ITj , . . . ,11^ is l =1 k and 

that ©j , . . . ,© k are unknown. The populations and n <k> are 

called the lower extreme population <LEP> and the upper extreme 
population (UEP) , respectively. Under the assumption that the 
parameters are location parameters < f y <x;© ) = f(x-© ) for some 

i 1 1 

probability desity function f(x), i = l,...,k>. Mi shra and 

Dudewi cz <1987) considerd the problem of simultaneously selecting 
LEP and UEP and proposed selection procedures in the so-called 
"subset selection" formulation of Gupta (1956). Ri sko <1985) has 
studied the problem of selecting the UEP when k = 2 and © is the 

Ob* ‘ 

single trial success probability of/binomial distribution, i=l,2. 



The present dissertation continues the study of Mishra and 
Dudewicz (1987) and Risko (1985) by contributing some optimal 
procedures for simultaneous selection of LEP and UEP. A brief 
account of work reported in the thesis is presented in the 
following paragraphs. 

In Chapter I a detailed review of the literature on ranking 

and selection procedures related to our study is given. In this 

CK/ 

review we have also included ^few papers which deal with some 
optimality aspects of the selection procedures which we have not 
studied in the dissertation. The papers included in the review are 
classified into ten groups, namely, (i> Classical procedures, 
( 11 ) Best invariant and Bayes procedures, (iii> Minimax 
procedures, (iv) Two-stage procedures, <v) r-minimax procedures, 
(vi> Locally optimal procedures, (vii) Empirical Bayes procedures, 
<viii> Asymptot i c^cons i stent procedures, (ix) Optimal procedures 
under heteroscedast i c i ty , and (x) Procedures for simultaneous 
selection of extreme populations. 

In Chapter II we approach the problem of simultaneously 
selecting two non-empty subsets and Sy, containing LEP and UEP, 
respectively, from Bayesian point of view. We extend some results 
of Goe 1 and Rubin (1977) who studied the problem of selecting a 
non-empty subset containing UEP under a specific loss function. If 
the probability density functions possess monotone likelihood 
ratio property and if the prior distribution is symmertric, then 
(a) an essentially complete class of rules for finding Bayes rule 
with respect to a general loss function is obtained; (b) for a 



semi -addi t i ve and non-negative loss function, Bayes rule is 

derived; <c> it is shown that Bayes rule of (b) is minimax and 

admissible; <d> for a specific loss function, an essentially 

complete class of rules for finding Bayes rule is obtained when 

the selected subsets are required to be disjoint; and <e> the 

results of <d> are applied to normal population models. 

* 

In Chapter III we study Bayes-P and minimax rules for the 
problem of simultaneous selection of LEP and UEP , extending the 
results of Berger (1979), Gupta and Yang (1985), and Gupta and 
Mi escke (1986). Under the assumptions similar to those of Chapter 
II <a> an essentially complete class of rules for finding Bayes- 
P rules is determined; <b) a modification of Bayes-P rules is 
studied and Bayes rule is obtained for the modified formulation; 
(c) it is shown that for a specific loss function selection rule 
of Mishra and Dudewicz (1987) is minimax in the class of rules 
satisfying P condition; and <d> for the normal models, it is 
shown that the natural decision rule which selects the populations 
associated with the smallest and the largest observations as LEP 
and UEP, respectively, is minimax if and only if the population 
variances are equal. 

Chapter IV deals with the optimal two-stage procedures for 
simultaneous selection of extreme populations. After formulating 
the problem and defining the two-stage procedures, we derive 
two-stage Bayes and two-stage permutation invariant procedures for 
a general loss function under the normal model. 



Under the indifference-zone formulation, the problem of 
finding minimax rules for selecting the better of two binomial 
populations with unequal sample sizes is studied in Chapter V. 
When the risk is measured by the probability of incorrect 
selection, an attempt has been made to characterize the minimax 
rules. Some necessary conditions for a selection rule to be 
minimax are derived. Most of the results of this chapter have been 
publ i shed . 
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CHAPTER I 


INTRODUCTION AND A REVIEW OF LITERATURE 

1.1 Introduction and Outline 

About thirty five years ago statistical inference 
problems were first formulated in the now-farm liar "ranking and 
selection" framework in their pioneering work by Bechhofer (1954) 
and Gupta (1956). A large number of active researchers have 
contributed to the area of ranking and selection procedures since 
then. The present dissertation continues this study further by 
contributing some optimal procedures for selecting the extreme 
populat i ons . 

In order to make the presentation as self contained as 
possible, we give a detailed review of the relevant literature in 
Section 1.3 of this chapter. Some preliminary definitions and 
notation are introduced in Section 1.2. 

The problem of finding Bayes procedures for selecting extreme 


populations is 

cons i dered 

in Chapter 

I I . 

For the goal where 

selected 

subsets need not 

be disjoint. 

an 

essentially complete 

class of 

rules 

for finding 

Bayes rule 

1 s 

derived for a very 


general loss function and results obtained are applied to more 
restrictive class of loss functions. The goal of simultaneously 
selecting disjoint subsets containing extreme populations is also 
considered. For a particular loss, an essentially complete class 
of rules for finding Bayes rule is obtained and application to 


normal distribution is made. 
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* 

Chapter III deals with the problem of finding Bayes-P rules 

(Bayes rules for which posterior probability of simultaneously 

selecting the populations associated with the smallest and the 

# * 

largest parameters is atleast P , where P is a pre-assigned 

constant) and minimax rules. For normal distributions and for a 
very general loss function, an essentially complete class of 

two-stage rules for finding best invariant two-stage rule is 

obtained in Chapter IV. 

The problem of selecting the better of two binomial 

populations with unequal sample sizes is considered in Chapter V. 
Necessary conditions for a rule to be minimax are derived. 


1.2 Definitions and Notation 

For uniformity we will adopt the following notation in 
this thesis. Let Xj,...,X^ be k (> 2> random variables (r.v.'s) 
from populations respectively and suppose that the 

random vector X = (X^ X^) has probability density function 

(pdf) g„ (.;©) depending on k-dimens 1 onal vectors of parameters 

A , Ot ^ 

(V rv 

e = (©.,...,©.) and o = (#.,...,a ). Let O x A denote the 

<v * K IK 

parameter space. In most of our presentation we will be dealing 
with the case where X^ X^ are independent and a is known, in 

which case we will suppress the dependence of the joint pdf on a 


by dropping it and denote our parameter space by O, pdf of 



X 


by 


J 


(X. 


•V 


by 


9 X< 


; © > and pdf of 



) 


k 


<i = 1 k ) so 

that g x < . ?©) 

= n 

f x . * ■ ,e 1 > ' 



i = l 

1 

Definition 1.2.1 

Let © [n < . . 

. < © 

£ k ^ denote the ranked values 


CL 

of ©j © k . Let 

tz t j denote 

'CTInu 

population associated with 


the l-th smallest of © ' s. Any other population or sample 
quantity associated with will be denoted with a subscript <i> 

attached to it. 

Throughout we assume that there is no prior knowledge about 

which of rij n k is n {j) , 1 = l,...,k and that ©j © k are 

unknown . 

Definition 1.2.2 Let X i j,...,X. n denote a sample of size n^ 

from n , 1 = 1 k. Let T = T (X X ) be a function of 

1 1111 in. 


l 


the sample from Let T 

Tj T k . Then we denote 

the l-th smallest of T ’s, 

l 

sample quantity associated 
subscript Ci} attached to 


Cl] 


< T^ k ^ denote the ranked 


Cil’ 

Any other population or 


the population associated with T, 

by "uk 

with will be denoted with a 

1 1 . 


Definition 1.2*3 

Populations and 

”<k> 

are 

called the 

lower 

extreme population 

<LEP> 

and 

the upper 

extreme 

population 

<UEP> 

respectively. Sometimes 

UEP 

will also 

be 

referred to as 

the 


"best” population. 

Definition 1.2,4 Let 0<A*> = C© : © [k:) - © [k _ 13 £ A*} and 
n<A*.A*> = C© : © m - e zl3 > A*. - 0 [k _ n ^ A*>. for some 

A ' Aj. A 2 > 0. 
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Definition 1*2.5 If © is a location (scale) parameter of the 
distribution of r.v. X, then f^(x,©) = f(x-©) ( i f(x/©) ) 
where f(.) is a pdf independent of ©. 

Definition 1«2«6 A pdf f(.;©) has monotone likelihood ratio 
(MLR) property if for x^ > x^ and 9 ^ > 9 2 

f(Xj ;© 1 )f(x 2 i© 2 ) - f (Xj ;© 2 )f ) - 0. 

Definition i.2. 7 A joint pdf g(x:©) is said to have generalized 



Definition 1.2.8 A distribution function (df) F(.;©) is said to 
have stochastically increasing property (SIP) if for 9 ^ > © 2 
F( x ;@j > < F ( x ;© 2 ) , V X. 

Definition 1.2.9 Let j# denote the action space associated with 
a problem under study and suppose that G denotes the group of 
permutations on the indices 

In the selection problems that we consider generally 

consists of either a subset or a pair of subsets of the set of 

populations Ctt. , . . ,n. 1 . Any such subset B = in. , . . . ,n . > will be 

IK 1 1 i^ 

written simply as Cij,...,i^} so that je B will mean e B. 

Definition 1.2.10 Let g « G, B = Cij i^l e Cl k> and 

x = (Xj , . . . , x^> . Then gB = Cgi^ gi^} denotes the image of B 

under g and gx = (x , x >, where g * denotes the inverse 

~ g 1 1 9 k 
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06111111100 1.2.11 A loss function L is said to be permutation 
invariant if L(0,a) = L<g6,ga> (or L<0 , <a. , a. > ) = L< g© , < ga. , ga ? > > 

A/ #y 1 £ /V X Cm 

in case j4 contains pairs of subsets). V g e G, © e O and a e sf 
( <a^ ,a 2 > e . 


Definition 1*2# 12 

A decision rule <5 

i s 

a measurable 

map from 

X x sf 

to [0,1] such 

that J 6<a|x> = 

1 . 

< 

! X 

m 

X, 

where 

X l s the 



a&rf 






sample 

space of the 

observation vector 

X 

= (X 

1 • ’ 

...x k > 

Let $ 5 

denote 

the class all decision rules 

<5 

for 

a 

given 

deci s i on 


problem. 

Definition 1.2.13 Let £ be a decision rule for selecting UEP. 

Then y/^(x> = ^ <5(ajx>, i = 1 k. are called individual 

a ejtf : i €a 

selection probabilities associated with decision rule 6. 

For any decision rule 6 for simultaneously selecting LEP and 

UEP yfi ( x ) = ) <5(<a..,a ? >|x> (i,j = 1 k> 

(a ^ iea^ , jea^ 

are referred to as pair selection probabilities associated with <5. 

Definition 1.2.14 A decision rule <5 for selecting UEP 
( simultaneously selecting LEP and UEP ) is said to be permutation 
invariant if <5(a|x> = <5(gajgx>, V g.a, and x ( «5< <a^ ,a 2 > | x) = 

<5( <gaj , ga 2 > | gx> , V g, Ca^.a^, and x ). 

Definition l»g. 15 A decision rule 6 for selecting UEP is said to 
be monotone if for every i e Cl k> and x , x'e X with x < x'. 

A/ 11 

& 6 

and x. S: x'. , j s* i , we have y>. < x' > > y/. < x >. 
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Definition 1.2.16 Let 0( . ) and $(.) denote the standard normal 

pdf and df respectively, that is 

2 

4>(.y) ~ — - — e y ^ ^ , -oo < y < oo 

V27F 


and 


y 

$(y) = J* *>(x) dx , -oo < y < oo. 

—oo 

Definition 1.2.17 Let F<.) denote some df Then for a * -1 , F a <x) 
a - 1 

denotes [F(x)l , while F <y> denotes the inverse of F<.) 
evaluated at y. 

Definition 1.2.18 A prior distribution t( 0) on Q is said to be 


permutation invariant (symmetric) if x(0) = x(g0) , V 0 <= Q and 


g e G. 


Definition 1.2. IQ A " Correct Selection " <CS) is defined to be 
an event which fulfils the goal of the problem at hand. 

Some other definitions and notation, which are used less 
frequently, will be introduced as and when such need arises. 


1.3 Review of the Literature 

The work of Bechhofer (1954) and Gupta (1956) gave rise 
to two main approaches to ranking and selection problems which 
have come to be known as the indifference-zone approach and the 
subset selection approach. In indifference-zone approach the basic 
goal is to select certain "best” populations. The procedure should 
be such that the probability of achieving the goal is at least P 
whenever the parameter vector 0 lies in a certain subset of O 


called the preference-zone. The region complementary to the 
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preference-zone is called the indifference-zone. In subset 

selection approach the goal is to select a non-empty subset S of 
Crr j , . . . 3 such that the selected subset contains certain "best" 

populations. The selection procedure should be such that it 

achieves the goal with probability at least equal to P for all 

© e O. Since the inception of the field, many variations and 

generalizations of the above two goals have been considered. 

In this section we review the literature on ranking and 
selection related to our study. In this review we have also 
included few papers which deal with some optimality aspects of the 
selection procedures which we have not studied in this 
dissertation. The papers included in review are classified into 
ten groups, namely. <I> Classical procedures. < 1 1 > Best invariant 
and Bayes procedures, (III) Minimax procedures, (IV) Two-stage 

procedures, (V) r-mimmax procedures, (VI) Locally optimal 

procedures, (VII) Empirical Bayes procedures, (VIII) Asymptotic 
consistent procedures. (IX) Optimal procedures under 
heteroscedast 1 c i ty , and <X) Procedures for simultaneous selection 
of extreme populations. 

CI3 Classical Procedures 

Consider the goal of partitioning k normal populations 

with means ©j ©^ into s disjoint and non-empty subsets 

Aj,...,A such that Aj contains kj worst populations (populations 

associated with k^ smallest means), A^ contains k^ next worst 

populations (populations associated with k^ next smallest means), 

.... and A contains k best populations (populations associated 
s s 

with k largest means), k, + . . . + k = k. For i=l,...,k, let X, 

SIS l 
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denote the sample 

mean based on a random sample of 

s i ze 

n ( from 

7T t . Assuming that 

2 

the variances a j , . 

2 

are known. 

Bechhof er 

(1934) proposed 

a single sample 

procedure 

wh i ch 

ass i gns 

populations associated with X „ 

Ck r-l + n 
r 

y » 

• *[k 

r - 

j+2] ’ ’ 

y *• 

■ * ’ Ck 

..to A , 

where k = \ k 

r L i 

A 

and k = 0 , and 

o 

showed 

that 

this 

procedure 

i = 1 



_* _ 

Us 

_* 


achieves the goal with probability at least P (-, 


< P < 


1 ‘ ‘ 


1) whenever A 


kj+l.kj = ^Ckj+l] “ e Lk i l ~ ^k +1 , k * 1 




In particular case when s = 2, kj = k-1 , = 1 , n^ = n^ = n, a . = 

2 

o,i = 1 k, the common sample size n required to achieve the 


goal is given by 
oo 


J $ k 1 (.y + Vn 6* k l /o) <p(y) dy = P* 


(1.3.1) 


Values of n satisfying (1.3.1) are tabulated for various values of 
P*. k. and 

Gupta (1936) proposed decision rules for selecting non-empty 
subsets of k normal populations which contain the "best" 
population (associated with the largest mean 0^^) with 
probability at least P . The variances were assumed to be equal 

and cases of known and unknown common variance were treated 

2 _ 
separately. Let a be the common variance and let X t denote the 

mean of a random sample of size n from i=l,...,k. In the known 

2 

o case the proposed rule is 


R. : Select n if and only if X. > X ri _ - — 

1 ■ 1 m VR 

* 

where d = d(k,P ) > 0 is chosen such that 


O f P ® < " <k> 


= p*. 


is selected) 
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2 2 
When & is unknown the rule is same as except that a is 

2 

replaced by the sample variance s . The expected subset size is 

* 

shown to be less than or equal to kP . 

Seal <1999, 1997) proposed a class S of decision rules 

k-1 

D<Cj c k-l^ ^ c i ~ 0, J 0 ^= 1 ) for selecting a subset of k 

i = l 

normal populations containing the best. His class S consists of 


decision rules of the form 


k-1 


Se 1 ect n i f f X 

i 


w< 1 ) 


1 " 2 c ) X [)] ~ st _* (c i c k-l > 


j=l 


?< i > 


where X is the mean of the sample from n , X ‘ ' < 

l i Cl 1 


< X <U 
•“ A Ck-l] 


denote the ordered X.’s after deleting X t <i = 1 k> , and s is 

2 

the usual pooled unbiased estimate of common variance a . 


Constants c^ c k-l and ,C 1 c k-l* are chosen so as to 

satisfy the probability requirement. Let D denote the decision 

o 

rule with c } = , i=l k-1 and let D(r) denote the decision 

rule with c =1 and c. = 0, j * r, r=l , . . . ,k-l . A comparison 
r j 

between rules D<1>, D(k-1> and D is made and it is recommended 

o 

that decision rule D(k-l) should be used. Rules D and D<k-1> are 

o 

referred to as average type and Gupta's maximum type rules, 
respect ively. 


Let Xj,... t X^ be independent random variables representing 

binomial populations rij , . . . ,n^ with common number of trials n and 

single trial success probabilities ©j, .... © ^ , respectively. For 

the problem of selecting the 'best' population Sobe 1 and Huyett 

(1997) propose the rule which selects the population associated 

with X r . _ . They show that for this rule the infimum of P^tCS) 
L k j w 
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over Q(A > is 
A* « <0,1 > is 
common sample 


attained when ©^.j = . .. = 
a pre-spec 1 f 1 ed constant, 
size n needed to guarantee 


®CK-n * e ck] ' 

Tables giving 

P e <CS> > P*. V 


A*, where 
smal lest 
© « 0(A*> 


for various values of k. A and P are provided. 

For selecting a subset of k binomial populations containing 

the best, Gupta and Sobe 1 (I960) propose a maximum type procedure 

R., : Select rr if and only if X > X r .^ - d<k,P*> 

M i i [k] 

where d<k,P > > 0 is a constant chosen so that 
P e <CS) > P* . V © € fi. 


It is proved that inf P^(CS) occurs when ©, = ... = ©. but 

O Z 1 k 

inf P_<CS) is not independent of this common value, say ©. For k=2 

a Z 

inf P-<CS> occurs at © = -^ but for k > 2, the common value at 

a Z 2 

which inf P_(CS) occurs is not known. However, as n — ► oo, this 

n z 

common value tends to ^ . 

Gupta <1965) proposed procedures for selecting subsets 
containing the populations with the largest location (scale) 
parameter. Let Xj , . . . .X^ be independent random variables with 
pdf's f <. ;©j f< . ;© k > , respectively, having the MLR property. 
In the location parameter case the rule is 
R 2 : Select n i iff > X [k;j - d(k,P*> 
and in the scale parameter case the rule is 
R ? : Select iff X. > c<k,P*> X^ 
where d > 0 and c e <0,1 > are chosen so that 


inf 

Ci 


P 0 <CS) = 
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Let | 5 | denote the cardinality of the subset S selected by rule R^ 
(or R^). Then it is shown that 

(i> inf P 0 (CS> and sup E^ClSl) occurs at ©,=...= ©. ; 

a Z o Z 1 k 

(ii> n e S ) > P- ( n. « S >. if 9 >9 ; <iii) sup E-<|S|> = 

t> i & j l j & i i 

<V /V *« M 

kP* and that P 0 < rr <k> e S ) > P 0 < e S* > for every subset S* 

such that |S |=|S|. Tables for applications are provided. 

(II) Best Invariant and Bayes Procedures 

Bahadur and Goodman <1952) explored the problem of 
selecting UEP using dec i s l on-theoret i c approach. Suppose T 
denotes sufficient statistic based on observations from n and 

l 

suppose that joint pdf of T = (Tj T^> is given by 

k 

g <t ; 6>) = C<©> n f<t . ;© . > 
l ~ ~ ~i=l 11 


where f < . ;0 > has MLR property. Assume that loss incurred in 
selecting n. when 9 is true parametric value is L <©>. Under the 

1 N 1 

assumption that L.(©> is permutation invariant and L.<©> < L.<©> 

In. 1 w In 


for © > © , it is established that natural decision rule which 

i J 

selects the population yielding T^ k ^ uniformly minimizes the risk 
among all permutation invariant procedures based on T. Since here 


the group G of permutations is finite. it follows that natural 
decision rule is minimax and admissible. 

Later Lehmann (1966) gave an alternative proof of the result 
proved by Bahadur and Goodman (1952). 
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For the goal of selecting a subset of Cn^ , . . . .n^l containing 
UEP Studden (1967) used the following loss function 

L<© , a) = 7 l <©> + c I, _ .. 

~ L l Crr.. ,esa> 

l ea 

where c > 0 is a constant, I D denote the indicator function of a 

D 

set B, and L<©,a) = L<g©,ga> V ©,a and g. Let Ci. - { 9 : 9. < 9. , 

*V M M K ^ 1 K 

i = l,..., k-1 }■ and let 

p i < ^ : ? > = Jk ^ T ^ g x <x ; ©). 

-1 

g : g k = i 

It is shown that a decision rule 6 is best invariant ( it has the 

smallest risk among all invariant procedures ) if and only if 

k 

1 , if cp.<X ;©> > \ l <©> p (X !©> 

K m m Lt 1m 1mm 

1=1 
k 

0 , if cp <X;©> < y l (©) p <X;©> 

1=1 

for © € ft. a.e. The functions y <x>, i x k are defined by the 

K 1 /V 

invariant condition. Applications to normal and exponential 
distributions are made. 

Eaton (1967) considered the general goal of partitioning a 

set of populations {rt^ rr^} into s disjoint subsets Aj , . . . ,A g 

such that Aj contains population corresponding to k^ largest ©^, 

A^ contains population corresponding to next k^ largest © ^ 

and A contains populations associated with k smallest ©., where 
s 

1 < k. < k, J k j " k * Here the action space consists of all 
i = 1 

partitions A = (A 1 ,...,A ) of (1 kl. Let the element of group 

1 8 

of permutations which interchanges i and j, leaving all other 




1 ? 


members of ( 1 kl fixed be denoted by <i,j) and suppose L(©,A) 

A* 

denotes the loss associated with the partition A when © is the 

true parameter value. For the partitions A = (Aj A g ) and A' = 

(A'j AM with i e A^. l e A^ +1 . ) «= A^. ) e A^ +J <for some ft, 

0 < ft < s> and ( l , j ) A' = A, suppose L(©,A) < L(©,A' ) when © > © . 

A/ A# * J 

and suppose L<© ,A> = L ( g© , gA > V ©, A and g. Under the assumptions 
that the joint pdf of random observable X = (Xj X^> CXj 

corresponding to r^] has a certain property M [namely, x t ^ x^ and 

© > © implies that g <x;©> > g v < x j < l , j )© ) , where < i , j )© is the 

l) x „ „ A ^ ~ ~ 

vector © with the components © and © interchanged] and the prior 
AT ^ J 

distribution r is symmetric it is shown that natural decision rule 
which takes Aj = {rr + i } "(k}* 1 A 2 = * n Ck-kj -k 2 +l 5 

^Ck-k and A s = ■*”£!> n Ck 1S Bayes - Thls rule is 

1 s 

further seen to be best invariant and hence minimax and 
admissible. Note that result proved by Eaton is a generalization 
of a result obtained by Bahadur and Goodman <1952) and Lehmann 
<1966). We make use of these results in Chapter II to determine a 
Bayes rule for simultaneous subset selection of LEP and UEP . 

A lam <1973) noted that there may exist distributions for 
which posterior distributions possess SIP but they do not have 
property M. Motivated by this he studied the problem considered by 
Eaton (1967) for s = 2, when the posterior distribution with 

respect to a symmetric prior r possesses SIP and is invariant. 
Under the assumption that the loss f unct l on is permutation 
invariant and it is non- i ncreas i ng (non-decreasing) in ©. for 
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l € Aj (A^), he proved that the natural decision rule is Bayes 
with respect to r. Under an additional assumption that the loss 
function is bounded and continuous in 9, natural decision rule is 

shown to be admissible. 

For selecting a subset of Crtj rc k } containing UEP, Dee 1 y 

and Gupta (1968) considered the loss function 


L<© , a) = X ft <a> <e r . .. - 6 >, ft <a) > 0 

»v iu 1 L K J 1 1 


Let Xj X k be independently distributed, X. from having a 


normal distribution with mean 6 and variance 1. Suppose that 

k 1 

prior distribution r(©)= n t (0 >. Under the assumption that ft (a) 

~ 1=1 1 1 1 


= ft > 0 for every a whose cardinality is one, and ^ ^(a 


) 


ft 


iea 

for every a e sf , it is shown that Bayes rule selects only one 
popu lat i on . 

Chernof f and Yahav (1977) considered the goal of selecting a 

subset of k normal populations having means ©j , . . . ,© k and a common 

2 

known variance a . For the loss function 

Lce. a > = c(e [k] - max 9.> + \ e. 

lte iea 

where c is a positive constant. Under the assumption that 9 has 


symmetric multivariate normal prior, a Bayes procedure is obtained 
and compared with the procedures of Gupta (1969) and Desu and 
Sobel (1968). Using Monte Carlo simulations, it is empirically 
shown that Gupta's rule is highly efficient. 

With the nonlinear loss function 

L(©,a> = c|a| + “ max ©.), c > 0, 

~ tea 
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Goe 1 and Rub 1 n <1977) investigated the problem of finding Bayes 

rules for selecting a subset containing the best of k independent 

populations with pdfs having MLR property. For j = 1 k, let <5. 

be the rule which selects with probability one <w.p. 1) the subset 

corresponding to j largest observations and suppose that r is a 

symmetric prior on ft. It is shown that the class of rules -{<5 . , j = 

I k}- is an essentially complete class for finding Bayes rules. 

Under an additional assumption that the prior distribution t is a 

mixture of independent and identically distributed random 

variables, Bayes rule is simplified. An "approximate" Bayes rule 

is also obtained which selects larger subsets than the Bayes rule 

but is the Bayes rule for k = 2. Under the assumption that prior 

distribution of belongs to a location parameter family, it is 

observed that the approximate Bayes rule is similar to the rule 

proposed by Gupta (1965). In the special case, when observation X. 

2 

from n has normal distribution with mean 9. and known variance a 
i l 

and 9 has symmetric multivariate normal prior distribution, it is 


shown that if 


J § m <z> $ <-z)dz < - < .56419 


then the maximum size of the selected subset is m and if — > 

Y 

2 

.56419, then the Bayes rule selects -{tt c k w,p * where Y * s 'the 
common posterior variance. We extend these results to the problem 
of simultaneously selecting LEP and UEP in Chapter II. 

For selecting a subset of normal populations, with unknown 


means and common known variance, containing the UEP 


and Hsu 


(1978) assumed that the loss function is given by 
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L<© , a) 

and that the 


C 1 'tn (k) «> + C 2 1*1 • 
prior distribution of 9 


c j • c 2 2: 0. Cj + c 2 = 
is multivariate normal 


1 

wi th 


mean vector /j1 and covariance matrix rl + t 11' , where 1' = 
< 1 , . . . , 1 > , r > 0, - ^ < t and I denotes the identity matr i x , and 
obtained the Bayes rule 

Rg : Select n ^ iff X t 2: X ^ ^ and/or P<©. = ©^^|X> 2 c 2 /Cj . 

Monte Carlo comparison of rules Rg, Gupta’s (1965) maximum type 
and Seal’s <1955) average type for k = 5 and k = 8, indicate that 
the maximum type procedure does almost as well as Bayes procedure. 

Mi escke <1979) extended the result of Deely and Gupta <1968). 
by assuming a loss function 


l_<© , a) = £ ft <a) l <©) . 

iea 1 1 ~ 

where . <a) = f?< | a j ) satisfy m/?<m) 2 /?<1), for m = 1 k and 

•^'s are non-negative. It is proved that there exists a Bayes rule 
which always selects only one population. For an additive loss 

function, L<© ,a> = ^ £.<©)>, sufficient conditions for a rule 6 

iea 

S 6 

to be ordered [for which w <x) 2 y> <x) whenever x < x . , V x e 3C ] 

1 ~ i ~ i J 

and monotone are derived. Also for selecting a subset of normal 
populations, it is shown that <i) Gupta’s <1965) maximum type rule 
is a limit of Bayes rules with respect to symmetric priors and 
loss function 


L( !'*> - 1 i<e m - e i - *>• 

i<=a 

where t is bounded and increasing and <ii) Seal’s <1955) average 
type procedure is Bayes for the unrealistic loss function 
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k 

L ‘!' a> ' I (r I e , - e i - *)• * > 0 

1 ea j = 1 

B i ornstad (1981a) derived best invariant rule for the problem 
of selecting a subset S, containing the best, of k populations 
having pdfs with the MLR property, and such that |S| £ t, a given 
number. For the loss function 


L(©,a) = £ ft (a) t (©) , 
~ i l „ 

iea 


where (3 (a) 

= 0<|a| ) 

satisfy [ -^-3 

fi(T) 

> fti t ) , IA9) > 

0. ^ 

(©) = 
A/ 

l ( g© ) , V 9 
9 1 ~ — 

e Cl, g e 

G, and /.(© 

) > t 

) 

(©), for © < 

A/ 1 

B t 

J 

it is 

proved that 

natural 

decision 

rule 

which selects 

the 

subset 


corresponding to the t largest observations (with ties broken at 
random) is best invariant. For the loss function L(©,a) = 

S /.(©) with t (©) satisfying l (©) > t (©> for © < ©., a class 

L i ~ i ~ i ~ ) ~ i J 

l ea 

of likelihood ratio type procedures is shown to be admissible. 

ft 

The concept of a Bayes-P decision rule was introduced by 

ft 

Gupta and Yang (1985). A decision rule <5 is said to be Bayes-P if 
it has the smallest Bayes risk among decision rules for which 
posterior probability of correct selection is greater than or 
equal to P*. a specified constant. With a symmetric prior r(©) on 


define statistics T. 

(X) = PC © a o 

Ck3 | ~ 

>• 

i =1 . . 

. . ,k. A 

decision rule 6 for 

the problem 

of selecting 

a subset of 

(rij , . . . containing 

UEP is said to 

sat i sfy 

the 

ft 

PP -condition 

* s 

(posterior-P -condition) if, y/ f|< j(x> = 

■ p ["<io is 

se 1 

ected 

<5. X=xl 

+* J 

= 1 . and p£cs <5,X=xJ = 

P^Select 

<5,X=xl > 

P*. 

for 

all x . 
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B B 

Define rules 6 and 6 as follows 


<5 B r 1 

-Ci><^ = ( 0 


, if l > j 
, otherwise 


where 1< j<k is the largest integer such that ^ Tj.^(x> 2: P*. and 

i = ) 
k 


-B 


*<,><?> - i r. 


i . 


o. 


if l T m < P*. J * k 
1 = J 

k k 

if J T m < P* and J T m <x) > P*. 


1 = 1+1 


otherwi se 


1 = ) 


where the constant y is determined so that y T^.-jCx) + 
k 

^ T^^Cx) = Suppose that the pdf’s under consideration 

1 = 1+1 

have MLR property and the loss function satisfies <i> L(0,a> = 
L(g0,ga>, (l i) L(0,a> is non- i ncreas l ng in 9. for i e a, and 
< i i i > L<0 ,a> £ L<0 ,a' ) , if a c a' , for all g € G, a e and 

/s/ 

D D ^ 

9 e O. Then, it is shown that 6 (<5 ) is Bayes in the class D <2> > 

of all non-randomi zed (randomized) decision rules satisfying 

<¥> 

* B B 

PP -condition. The decision rule 6 (.6 > is shown to be most 

efficient in the sense that for any decision rule & in D <S) > 


ef f (6 | x) = 


P(Selecting UEP|<5,x> 

ECSize of selected subset |6,x> 


_ _ ^ 

is not greater than eff(6 jx) <eff(<5 Jx)). Further, 


under 
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* b b 

PP -condition, the subset selected by 6 or 6 is always smaller 

than that selected by maximum type procedure proposed by Gupta 

B 

<1965); for k = 2 in normal location model, the rule y is same as 
the maximum type rule; and for non- i nformat l ve prior t(©> = 


constant, Gupta’s <1965) rule satisfies PP -condition. We derive 
Bayes-P decision rules for simultaneously selecting LEP and UEP 

in Chapter I 1 1 . ^ 

O/wyoLoJZJL v^otki tUz ^ Xa^^oY- O0>vJ'powe4- lu. e* Ac-\r<w'cJt cUohvv'l 

CIII) Mini max Procedures wOk ^ 

-k^-n r(k<^e~X*. ^ P v\-M cWjKa iavvW. , 

For selecting a subset containing the UEP, Berger (1979) 
proved that if the loss is measured by the subset size and if one 


restricts to the class 3> of decision rules satisfying 

P 


P*- 


condition (P^(CS) > P*. V 6 e O) then the minimax value of the 

<V 

problem is kP . This implies that the rules and proposed by 

Gupta <1965) are minimax. Some necessary conditions for a rule to 

be minimax are derived and it is observed that if a decision rule 

6 e 3) is minimax for loss measured by subset size, then it is 
P 

also minimax for the loss measured by number of non-best 

populations selected. In Chapter III we derive minimax rules in 

* 

the class of rules satisfying P -condition for the problem of 
simultaneously selecting LEP and UEP. 

Berger and Gupta <1980) obtained minimax decision rules in 
the class of non-randomi zed , just and translation invariant 
decision rules which satisfy P -condition, when the risk is 
measured by the maximum probability of including a non-best 
population. Under location <scale) parameter model, it is shown 
that decision rule R 2 <R^) proposed by Gupta <1965) is minimax and 
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admissible in the class of non-randomi zed . just and translation 

(scale) invariant decision rules which satisfy P - condition. 

Selection in terms of k normal populations with means 6^ 

2 2 

and unequal variances c. , . . . ,a. is also considered. The variances 

2 

2 r i 

may be of the former = — , i = 1 k, so that this formulation 

in 

l 

also includes unequal sample size problem. It is proved that the 


decision rule 


R_, . : Select tt iff X. > max 
GW 1 1 i<,<k 


2 -L 


(v-£ * r 4l 


proposed by Gupta and Wong (1982) is minimax in the class of 

non-randomi zed , just and translation invariant decision rules 
* 

which satisfy P -condition. 

Gupta and Huang (1980a) explored the problem of finding a 
minimax rule within the class of decision rules for which the 
infimum of the probability of correct selection over a subset of 
parameter space is guaranteed to be a specified number P . Let 
f . = ?. (©) be some measure of separation between n. and n and 

suppose that there exists a monoton i cal 1 y non- i ncreas i ng function 

h such that ? . = h(£ . .). Define Jf* = max min ? O. = IB : 

11 11 „l<SiSk j*i IJ 1 

# * * 

? . > A V j * i } , 1 < l < k and Ci = u n , where A and are 

i 1 i = 1 1 

* -If 

known and A > £ . ^ . The population associated with ? is defined 
to be the best population. Let the statistics 2^ . be based on n^ 

and n^ independent observations from n. and rc ^ ( 1 < i, j < k), 

respectively and suppose that for any l, the statistic Z. = 

A/ * 


> is sufficient and invariant under a transformation 
lk 



21 


group and = (? t j ,...,?. ^ ) is a maximal invariant under the 

induced group. Let g 7 ( . ;0) be the joint pdf of Z 's, j j* i 

Z\ ) 1 ] 

which will be denoted by g (.) when f, = ... = f . =?• = 

o s 1 1 s i k s l l 

* 

constant and by g^.) when = ... = = ^ . i = l,...,k. 

Consider the decision rule <5° defined by 


6 

V (z ) 
i ~ i 


r 1 . 

’ V 

. o . 


if g^zj) > c g 0 <z i ) 
ifg(z)=cg<z.) 

i ~ i O „1 

ifg(z)<cg<z) 
i ~i o „ 1 


& * 
where c <> 0> and X are determined by f ?. (z > g (z > dz = P , 

i J r l „ i l ^ i ^ l 

g ( z . ) 
i ~ i 

1 < i < k. Further assume that — r is non-decreasing in each 

g (z . > 
o „ 1 

component of z , g_ (.;©) has SIP and supremum of expected size 
~ l Zi) 

of subset selected by 6° is attained at f = f = constant, for 

i j i i 

all i,j. Then for the loss measured by subset size, the decision 
rule <5° is proved to be minimax among the rules for which P 0 (CS) > 


* 

P , V 6 € O. Application to normal distribution is made in which 

case decision rule 6° reduces to Seal’s (1955) average type 
decision rule. 

Now, suppose that ? . is known and £ . = min ? . , O' = C 9 : % . 

11 ~ l 

> £ }, l<i<k,? Sf j^i in case all S.’s are equal, 

ii i ) ii i 

and O = u O' holds. A population n is called best if 9 e O' 
i=l 1 1 ~ 

Under the above set-up Gupta and Huan g (1980b) consider the 
problem of finding a decision rule <5 which controls the expected 
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size of selected subset at the points of the form <© ©) and 

which maximizes the minimum probability of correct selection. 
Only those decision rules are considered which depend on 
observations through sufficient statistic for ©. It is proved that 

the class of monotone procedures forms an essentially complete 
class provided underlying distributions have generalized monotone 
likelihood ratio property. 

The problem of finding a decision rule which maximizes the 
minimum probability of correct selection while controlling the 
expected size of selected subset below a specified number was also 
investigated by Hsu (1985). Some optimal procedures are derived 
and application to normal distribution is made. 

CIV) Two-Stage Procedures 

Suppose we have k independent normal populations 

2 2 

JTj n k with means ©j © k and variances Oj a^, 

respectively. Dudewi cz (1971) proved that there does not exist any 

2 

single-stage selection procedure whose P(CS) is independent of a ^ , 

l = 1 k. In such situations one uses sequential or two-stage 

procedures to solve the problem. 

Bechhof er . Dunnet'fc , and Sobe 1 (1954) used indifference-zone 

approach and proposed the following two-stage procedure for 

2 2 

selecting UEP among k normal populations with variances a ^ - c a , 

2 

where c < 1 :£ l £ k) are known positive constants and a is 

l 

unknown. At first stage c.n observations are taken from each n. 

i o k 1 

(1 < i < k), where n is an integer satisfying n = n > c -k > 0. 

n n / i 
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Suppose 


and 


i = l 


c . n 

1 0 

c . n 

l 

V fx _ 1 

s 

Z l i ) c n 

i=i 

z 

j=l 

r 2s 2 h 2 T 
[ A* 2 ] f ' 


smallest integer 

> y 


(N-n >c additional observations are taken from rr , 1 = 1 k. 

o 1 1 

Then select the population associated with 

c N 

l 


X r . .. = max f— 7 X .1 
i<i<k l C X N / »U 


j = l 

as the UEP. The constant h = h(n,k,P*) is chosen so that P 0 (CS> 2 
P*. V e <e OCA*) . 

For the goal of selecting UEP using indifference-zone 

approach when the variances are unequal and unknown, Dudewi cz and 

Dalai C1973) proposed a two-stage procedure which takes samples of 

£ 

size n Q from i = 1 k at stages 2. Let s t denote the sample 

* 

variance based on these n observations from n and suppose h is 

O 1 

the unique solution of 
oo 

.k-1 


f ^ T<z+h ) f ,<z> dz = P , 
J n ~ 1 n -I 


“00 

where F , C.) and f , C.) denote the df and the pdf respectively 
n -1 n -1 

o o 

of Student ' s-t random variable with n -1 degrees of freedom. At 


stage 2 n -n additional observations are taken from n , where 

1 O 1 


n = max 

i 
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Let c. .’s be constants satisfying 


n 


1 * * 2 

> c , =1, c. , = ... = c , and s^ > c . = [— -1 . 

L i) il i n Q i L i j 

J=1 j=l 

The proposed procedure selects as the UEP the population which 

n 

l 

yields the largest X , where X = ) c . X .. It is shown that 

1 1 La 1 ] 1 ) 

j = l 

the probability of correct selection for this procedure is 

* 

independent of variances and its infimum over Q(A ) is attained 
when = ... = ®[k-l] = ^Ck] ~ ^ • Tables needed to implement 

the proposed procedure are given. 

Tamhane and Bechhof er <1977) proposed following two-stage 
procedure for selecting UEP. 

Ryg : At stage 1, take n^ independent observations from each 
of k populations and select only those n. for which X. > X^-j-d, 


1=1 k, where d ^ 0 is chosen so that 


inf P <CS) > P . If 
©eO(A ) Z, 


only one population is selected at stage 1, then stop sampling and 
select this population as UEP, otherwise take n^ additional 
observations from each n. selected at stage 1 and select the 
population yielding largest pooled sample mean as UEP. Note that 
d = 0 gives the single-sample procedure of Bechhofer <1954). It is 
required that for rule R^g 

P_<CS> > P*. V © € C!(A*> (1.5.2) 

It is shown that there are an infinite number of combinations of 

# 4S- 

(n^.n^.d) which satisfy (1.5.2) for any k and (A ,P ), and that 
different design criteria lead to different choices. They use the 
design criterion proposed by A lam (1970) : For given k and 
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* * 

specified <A ,P ), choose (n, ,n,,d) to minimize sup E-^kn., +Vn, ) 

1 2 0€CXA*> Z 1 2 

subject to inf P-<CS|R Tn ) 2: P , where V is a random variable 
©«=Q<A > ? TB 


which takes value zero if only one population is selected at stage 
1 and is equal to cardinality of the subset selected at stage 1, 
if more than one population are selected at stage 1. For k = 2, 
the least favorable configuration (LFC) is shown to be 9. 


Cl] 


. It was conjectured that for k > 2 also 


^Ck-1] = ^Ck] ~ ^ Later Miestke and Sehr <1980) gave 
a non-standard proof of the conjecture in case of k = 5 
populations. Recently, Bhandar i and Chaudhur i <1990) have shown 
that the conjecture concerning LFC of R^.g is true for all k. For k 
> 2, Tamhane and Bechhof er <1977) obtained a conservative solution 
by taking the mfimum over <KA ) of a lower bound of P e <CS|R TB >, 


and later Tamhane and Bechhof er <1979) improved upon it. 

2 

For the normal means with common unknown variance a , Gupta 
and Kim <1984) proposed a two-stage elimination type procedure. 

Now suppose that the same number of observations are drawn at 
stage 1 and stage 2 and suppose 

SjCx) = < . ■ X a * [k3 - c, c > 0 fixed > 

S£<x) = -t i : Xj is one of the t largest values of 

of 5<j )? k> t € C2 k-l> fixed }■ 

S 5 (x) = H ■*,*=,. Cj c k d R 1 } 

and let d. c and d 7 Q be decisions at stage 2 such that 

i t b L , U 

d. q <X,Y) = 1 , iff V. * max Y 
i ,b 1 jeS 1 
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d £ g < X , Y) = 1 , iff Xj+Yj = max (Xj+Yj) 

j €S 

where Y denotes the sample drawn at stage 2. 

<Sj,d 2 g ) corresponds to that of Tamhane and 

Gupta and Mi escke (1982) prove that for <S ,d. _ 

1 ) < is 

1,2, the LFC in C)<A*) is given by = ... = 

For (Sj.dj g >, they derive a lower bound for 


Note that rule 
Bechhofer <1977). 
>. i = 2.3, j = 

l 


®tk-n = 

P e (CS> 



which is 


•£ * 
minimized in Cl< A ) at = ••• = = A , a result 

similar to that of Tamhane and Bechhofer (1977). 

Gupta and Mi escke (1983) define the class of two-stage 

invariant randomized procedures <v,t), 6>, where at stage 1, v and 

r? , respectively decide how many and which populations to be 

selected and where at stage 2 after taking additional samples from 

the populations selected at stage 1, 6 makes a final decision for 

selecting UEP. Suppose that the observations from n. have pdf 

* * 

f^ = g<©.)b(x> expC©^) and let 7) and 6 denote the 


i 

decision rules which select populations corresponding to largest 
sufficient statistic. Let L(©,a,i> denote the loss incurred if 


subset a is selected at stage 1 and population n., i « a is 
selected at stage 2. Assume that L<©,a,i> = L(g©,ga,gi>, V © e O, 

g e G, a e sf and i e a. Further assume that for every fixed © € Q 

with ©j < © 2 and a c C3 k> with 0 S j a j < k-2, the following 

four conditions are satisfied 

(l) L<© , C2> , 2) < L (© , { 1 > , 1 ) 

A/ 

++ ++ 

<ii) L(©,a U C2 } , i ) £ L<©,a U Cl>,i). i € a 
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(ni) L(0 , a u Cl , 2 > , 2 > < L(0,a U Cl . 2 > , 1 > 

A/ 

<iv) L(0 , a u C2 ) , 2 > < L(0,a u Cl),l>, |a| > 1 

Under the additional condition that underlying pdf’s are unimodal, 

* # 

it is shown that procedures of the type (v,t) ,6 ) form an 
essentially complete class in the class of invariant decision 
rules and since the group of permutations is finite, best 
invariant decision rule is also minimax. 

The problem of finding two-stage Bayes procedures for 
selecting the UEP among normal populations with common known 
variance is studied by Gupta and Mi escke (1984a>. Following loss 
function is considered 

L(©,a,i> = c^nj + h(©> - + c^n^ V 

where c^ , c^ are constants, n^ (n^> are the number of observations 
per population at stage 1 (stage 2), V is a random variable 
which takes value zero if only one population is selected at stage 
1 and is equal to number of elements in selected subset if more 
than one population are selected at stage 1, and h(0> is any fixed 

A/ 

real valued function. Under the above set-up, a two-stage Bayes 
procedure with respect to independently and identically 
distributed normal priors is derived. Several properties of Bayes 
procedures are discussed. 

(V) r-Hinimax Procedures 

In r-minimax criterion, it is assumed that our prior 
information consists of a class r of distributions over ft and it 
is desired to find a decision rule that minimizes the maximum 
expected risk over T. Note that if T consists of a single prior. 
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we have a usual Bayes rule with respect to that prior while if r 
consists of all possible priors then r-minimax rule is the usual 
mini max rule. 

Gupta and Huang <1977) derived a r-minimax procedure for the 

problem of selecting a subset containing the best population. Let 

f be some measure of separation between rr and n., f = max f 
15 111 l<]<k 11 

and ft = <© e ft : F <£3,15 l < k, where £ is a given 

constant. The parameter space ft is partitioned into k+1 mutually 

exclusive subsets ft , ft, ft. , where ft is an indifference-zone 

o 1 k o 

(ft = <p is permitted). The population associated with min £. is 
° 1< j<k 1 

called the "best" population. Suppose that the loss incurred in 

using a decision rule 6 is given by 

k k 

L<e.<s<x)) =22 L i 1 ' > <e 'V'* (x>> 
i=l j=l 

where for any i, 1 < i < k, and ©eft, * (© , y^<x ) > = 0 for all 

« 1 1 M ] M 


l / 1 , 


L <l) <e,v'f<x)) = i 

* w J iv ! 


c y> <x) , for j * i 

i J J ~ 


0 , for j = i , 

c (l * i) are given positive numbers and c. = 0. For O e ft_ , the 
1 ) 11 ~ o 

loss is assumed to be zero. Further suppose r = { r<0) : f dr<©) = 

#y ^ a# 

ft. 

k 

q t , i = 1 k}-, so that J - 1 • and f° r i ~ 1. -.-.k, let 

i =1 


6 . eft. 
~ i l 


be such that 
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sup 

e«=Q 


k 



V, < 


i J J 


*0 


k 


(2 


0 i 

~ i j = 1 



(X) 


]■ 


where 


6 < ^ 
w < x > = 
i 


a 


if T <x) < min T (x> 
1 ~ 1< j<k 3 ~ 

if T (x) = min T (x> 
1 ~ 1< j<k 3 ~ 

J*1 


otherwise 


and T 


<x> = y c q f v <x,e*>. i < i < k, y 

i ~ L JijX„’i’ Z 


c* 


1 . It 


1 s 


j =1 ~ 1=1 

proved that the decision rule 6 is r-minimax and applications to 

different selection problems are made. 

Gupta and Kim (1980) investigated r-minimax rules for 

comparing populations "j • • • • with a control population 

Suppose that the pdf associated with i-th population is 

symmetric, ummodal and has location parameter 9 , i = 0,1 k. 


Define a population n to be superior, equivalent on inferior to 

re according as 0. ^6 + A*, or © - A* < 9 . < 9 + A* or 9. < 6 
o l o o l o l o 

* * 

+ A , where A > 0 is specified. Only those decision rules are 
considered for which the selection or the rejection of the i-th 
population depends on observations only through X q and X. With a 
reasonable loss function, T-minimax and minimax rules are derived. 

Randles and Hoi lander (1971) and Gupta and Hsiao (1981) have 
developed r-minimax procedures for selecting all "good” 
populations and rejecting "bad" ones, where a population is 
defined to be good (bad) if it is close to (away from) some 
control population. 
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(VD Locally Optimal Procedures 

For many classical procedures for selecting a subset 

containing the best population, the infimum of P<CS> occurs at the 

equ i parameter points ©j = ... = © k . This provided the motivation 

for deriving rules which are optimal in some suitable sense in a 

neighborhood of an equ 1 parameter configuration. 

Let the independent observations X X from tt have 

1 1 1 n l 

i 

pdf f<.;© i >, i = 1 k, where © belongs to an open interval 

containing origin. A rank configuration is defined to be an 

k 

N-tuple A = (Aj A^> , A t € Cl k> , where N = J n j and A^ = j 

i = l 

means that the l-th smallest observation in the pooled sample 


comes from n ^ . Define 


x.. 
oo N 


■», ■ I J -I 


9f(x ;©> 
J 


69 


-oo -oo 


-oo 


N 

II f<x ; 0 ) dx 1 ... dx N , 
© = 0 i=l 1 

i*l 


and 


v A> = 2 B , ■ 

J :A =1 


V = J A . (A) . 
i=l 


Let P 0 (A> denote the probability of observing rank configuration A 


when the value of the parameter is 9 with ©. * 0, l = l,...,k. 

A decision rule 6 for subset selection will be called locally 

optimal if inf P e <CS|6) = P , a specified constant, and P e <CS|<5> 
©eO Z 

~ o 

is maximum in a neighborhood go of © e Q = ■{ © : ©. = ...=©. )■ 

O ~ O O v i K 
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Gupta . Huang and Nage 1 (1979) consider the problem of finding 
a permutation invariant locally optimal decision rule 6 based on 
rank configuration A. Under certain regularity conditions on 
f(.;© >, l = 1 k, it is shown that the decision rule 6 for 


wh l ch 


r i 


if A (A) > c 

l 


y^A) = I p i , if A^A) = c 


0 . if A (A) < c 

l 

is a locally optimal, where constants p and c satisfy 


I 


p g <A) + Pi l p e <A) - p ' 

A : A (A) >c ~° A : A (A)=c ~° 

l 1 


It is also shown that, under the location parameter logistic 
model, the decision rule 

R : Select n iff H > d, 

l l 

proposed by Gupta and McDonald (1970) is locally optimal, where 
H t = average rank of observations from population n ^ in the pooled 
sample , l = 1 ..... k . 

Huang and Panchpakesan (1982) consider two types of goal 

namely, (l) select a subset of Cn^ containing UEP and <ii> 

select from , those populations, if any, for which the 

associated parameter values are larger than 9 , the parameter of 

o 

some control population. Consider the decision rule 6 for which 

1 


y/. (A) = -j 


if A (A) > V + D 

l 

p , if A. (A) = V + D 
0 . if A t (A> < V + D. 


where D and p are chosen such that V+D > 0 and for 6 e O , 

~o o 


P- (A. (A) > V+D) + p P a (A. <A) = V+D) = P . 

© l ©_ l 

~© ~o 
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For the problem of selecting a subset containing UEP it is proved 

* 

that decision rule 6 is locally optimal. For logistic density <5 
reduces to the randomized version of the rule proposed by Gupta 
and McDonald (1970). For i=l k, let 


00 N 2 f<x. ;©. ) - f < x . ; 0 ) 

V a '!> =2 XX •••X — — J 's — 1 — » 


l : A =i -oo -oo 
J 


-CD 


J-l 


N 


n f <x, ; o> n f <x , ; © . > dx. 
1=1 1 l=j+l 1 A 1 1 


dx 


N 


For selecting populations better than control, it is assumed that 

* 

© is unknown and there exists a known quantity © such that © < 

o o o 

©*. For this problem, the decision rule 6° defined by 


Vj <A> = -j 


P 

0 


if A <A,©*> > -rl 
i ~o ][N 


if A (A,©*) = -r-i 
i ~o 


if A <A,©*> < -,4 

l „o |_N 


* * * 

where © =<©,...©) and 0 < p < 1 and c. are determined so that 

~o o o 1 


1 V 6° ... _* 

TN Z ^i = " * ma><imizes 


X P e <rr. IS selected |©, = ©* < © , , j * i> 

1 = 1 1 ~ 


1 


l 


©. =©* 
l o 


among all procedures <5 for which 


P 0 (select n © e fi ,<5> < y for i = 1 k. 

C7 1 /w O 


For selecting populations better than control, Huang, 
Panchpakesan and Tseng (1984) consider only those decision rules 
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for which P- (nr is selected) - y , 1 = 1 . . . . , k for © =©=...=©. . 

& 1 1 OIK 

It is assumed that decision rule depends upon the observation 

through the statistics T , l = 1 k, where T is suitably 

l o l o 7 

defined to indicate the difference between n and tt . Let ¥ be 

i o ' 10 

the parameter associated with pdf of T . The parameter f is a 

1 o 1 o 

measure of separation between and . The local optimality 

criterion used amounts to maximizing 


k 


I 


d 




1 o 


E(y/^(X) > 



•=? 



> 


-ft 

where ? is a specified constant. 

C VII) Empirical Bayes Procedures 

The first contribution to ranking and selection problems 

using empirical Bayes approach was made by Dee ly <1965). He 

k 

assumed that r(©) = n t (© . ) and derived empirical Bayes rules 

i = 1 1 1 


for the problem of 

selecting UEP. His 

loss function 

is given by 

L(©,j) = 

A* 

C<e ck: - e i 

> 



(1 .3.3) 

where c > 0 is a constant. 





Later Van Ryz 

in (1970) 

general i zed the 

results of Deely 

(1963) to the case 

where ©j 

’ ‘ * -0 kj 

may not 

be 

independently 

distributed. For 

the loss 

f unct i on 

def i ned 

by 

(1.3.3). two 


empirical Bayes rules (depending on whether underlying pdf's are 
discrete or continuous) are proposed and are shown to be a.o. of 
order 1/Vn. 

Gupta and Liang (1986a, b) derived empirical Bayes rules for 
selecting best binomial population and most probable multinomial 



cell respectively, with respect to the loss function (1.5.3). 


Some other contributors to this area are Gupta and Hs iao 
(1983) and Gupta and Leu (1983) who derived empirical Bayes rules 
for the problem of selecting good uniform populations. Also Gupta 
and L lang (1984) considered the problem of selecting good binomial 
populations and obtained empirical Bayes procedures. 


C VIII3 Asymptotic Consistent Procedures 

Let <5 be a selection rule based on a sample of size n 
n 

with risk function R (.9,6 ). Let M(©) = min L(©,a>. Then the 

n ^ n „ - 

a e s$ 

sequence of selection rules C6 } is said to be consistent at 9 if 

n 


R (9,6 ) 
n „ n 


M(©) as n -»■ oo. We say that 6 is point-wise 

n 


consistent if 6 is consistent at each 9 € Q, while 6 is called 
n „ n 

uniformly consistent if 

sup CR (©,<$ ) - M(©)3 ► 0 for all compact subsets K of Q. 

© € K n ~ n 

B ) ornstad (1984) obtained some necessary and sufficient 

conditions for both point-wise consistency and uniform consistency 

of permutation invariant selection rules. For the case when n. is 

2 

a normal population with mean © and variance a , following six 


loss functions were considered 


( 1 ) 

L 1 : 

lT(© , a) 

^ A/ 

- *Ck3 

( i i > 

4 : 

L^(0.a) 

= e Ck3 

(in) 

S' 

Lj(©,a> 

- M 

( iv) 

L 4 : 

L^(©,a) 

= c 2 I 


4t I e i 


jea 


+ c(© r , - - max 9 > 
[k] l 

tea 


T a I S ©j+c 1 < max q < © > 

j€a i«a 1 LKJ 


tk3 


i«a 


i ' ~Ck3 


+ c £ | a 


tea 
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(v) : L^<©,a> = |a| + c J 


iiza 


<e > - w 


(v,> l 6 : L^(e.a> = l <e m -V ♦ c 


i€a 


i 


lea 


<6 \ = W 


where c, c^ , are positive constants. Let 6^ be a decision rule 
with associated individual selection probabilities 
„* 


^i" = 1 * lf * X [k] - S n d n 

= 0 , otherwise. 


<1 .3.4) 


where X n is the sample mean based on n observations from n , S is 
i in 

the pooled sampled variance and d n is a non-negative constant. 


Following results are proved 

( l ) 


Under the loss function L. <L_), 6 

1 Z n 

(point-wise) consistent if and only if < 


is uniformly 


n 


( 11 ) Under the loss function L, (L. ) , 6 is uniformly 

>4 n 


(point-wise) consistent if and only if Yn d. 


0. 


( 111 ) Under the loss 


f unct i on 


with c > 1 (L^) 


<5 is point-wise consistent if and only if d 
n n 


( Vn d 


n 


0 ) 


(iv) If inf P ,(CS 6 = P , (i < P < 1) 


then 


l s 


Ox A e ,<y 


uniformly (point-wise) consistent under the loss 
function Lj (L^) but not consistent under any of the 
other loss functions given above. 

Bjornstad also studied the consistency of admissible 
procedures derived by Bjornstad (1981a) and Bayes procedures 
derived by Chernoff and Yahav (1977). Goel and Rubin (1977) and 
Hsu (1978) under the respective loss functions considered by them. 
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Some necessary and sufficient conditions for point-wise and 
uniform consistency were obtained. 

B lornstad (1986) considered loss functions of the form 

V L 7<S' a> ' 2 /<e tkrV' 

iea 

hr 4 < ?- a> * ' ?< l a l> l 'fe 2 ■ ’}• 

i€a 

and 

L ? : L 9 <©,a) = | a | , 

where fti i ) > 0, l = and l i s a continuous, non-decreasing 

function with t(0) = 0, and £(x) > x if x > 0. Some necessary and 

sufficient conditions for point-wise and uniform consistency are 

developed for the class of decision rules satisfying 

P -condition. Applications are made to normal, multinomial and 

multivariate normal populations. It is shown that 

* 

(i> For selecting normal means <5 defined by (1.5.4) is 

n 

uniformly consistent. In fact Gupta’s (1965) procedure is 
the only procedure in Seal's (1955) class which is uniformly 
consistent. The other classes of uniformly consistent 
procedures are the exponential procedures studied by 
Bjornstad (1981, a, b) and the class of procedures considered 
by Gupta and Panchpakesan (1972). 

(ii) The rule proposed by Gupta and Sobe 1 (1960) is uniformly 

consistent for selecting binomial populations while the 
conditional rule of Gupta and Nagel (1971) is not point-wise 


cons i stent . 
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(ill) Class of minimax rules studied by Berger <1980) for 
selecting multinomial cells is not consistent. However. an 
admissible and minimax rule proposed by Berger (1982) and 
the rules suggested by Gupta and Nagel (1967) and Gupta and 
Huang (1975) are uniformly consistent. 

< l v) For selecting multivariate normal populations according to 
Mahalanobis distance the procedure investigated by Gupta 
(1966) is uniformly consistent, while the procedure based 
on maximum likelihood estimates considered by Alam and 
Ri zv l (1 966 ) i s not . 

B i ornstad (1985) studied asymptotic consistency of 
procedures for the problem of selecting good populations and 
obtained results similar to those of Bjornstad (1984, 1986). 

CIX) Optimal Procedures Under Heteroscedastici ty 

Suppose that the observation from is distributed 

2 

as normal with mean ©. and variance , i = l,...,k. For the goal 

of selecting UEP, it has been established that if the risk is 

measured by probability of incorrect selection, the natural 

N 

decision rule 6 which selects population corresponding to 

2 2 

the largest observation is minimax provided = ... = . The 

most general version of this "Bahadur-Goodman-Lehmann Theorem” is 

presented in Gupta and Miescke (1984b). Suppose the assumption of 

equality of variances is dropped, then f situation changes 

N 

drastically and no alternative of natural decision rule <5 has 
been found so far which can be cons i dered to be better in some 


reasonable sense. 
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When the risk is measured by 
selection, Gupta and Mi escke (1986) 
decision rule is minimax if and only if 


probab 1 
establ 


1 1 ty of 
ish that 



l ncorrect 
natural 

Let 


R<©,6> 
R<© ,6) 


= 1-P 0 (CS| 6 } 

- Tk l R<9 ?' a> 


geG 


<1 .3.5) 

<1.3.6) 


and let hj,...,h^ be k strictly increasing functions defined on 

real line. It is shown that if risk is measured by (1.3.6) then 

the decision rule which selects in terms of the largest h (X.), 

ii 

i = l,...,k is minimax and the minimax value of the problem is 

1 - i. When the risk is given by (1.3.3) no alternative decision 

rule is proposed and Bayes rules with respect to various priors 

N 

are studied to find reasonable modification or alternative to 6 . 

Now suppose that the observation X. from has a binomial 

distribution with single trial success probability ©. and sample 

size n , l = l...,k. For the indifference-zone approach . Hall 

(1959) proved that the decision rule proposed by Sobel and Huyett 

(1957) is minimax if n^ = ... = n^ and if the loss function is 

if a correct decision is made and zero otherwise, where 
P 

#1 # 

P <£• < P < 1) is a pre-assigned constant. The decision rule 
proposed by Sobel and Huyett (1957) is also found to be most 
economical. It is pointed out that if assumption of equal sample 
sizes is dropped then problem becomes exceedingly complex. 

For the case of unequal sample sizes, Gupta and Sobel <1958, 
1960) have suggested choosing the population which yields the 
largest proportion of successes (randomizing in the case of ties) 
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as the population with the largest success probability. This will 

be referred to as the intuitive decision rule. 

R 1 sko (1985) considered the problem of finding a minimax rule 

for selecting the better of two binomial populations < the one 

with the larger single trial success probability) using 

indifference-zone approach when the risk is measured by 

probability of incorrect selection and the sample sizes are 

unequal. Let the observation X from n have binomial distribution 

1 l 

with sample size n and single trial success probability ©., 
i=l,2. A decision rule 6 is desired which maximizes the minimum 
P<CS) over the subset fl(d> = { 6 : #££] - + d } of the 

parameter space, where 0 < d < 1 is a pre-assigned number. It is 

observed thet the natural decision rule which selects the 

*1 *2 

population corresponding to max-.t — , — > as the better population 

n l n 2 

performs very badly when one sample size is relatively larger than 
the other. When one sample size goes to infinity while the other 
is kept fixed, a minimax rule is derived. For the case when both 
the sample sizes n^ , n^ are kept fixed, a class of decision rules 
depending on two parameters ft ^ and ft 2 < Zft ^ < l+ft^ is proposed and 
the minimax rules within this restricted class arre obtained 


numerically for some values of n^ and n^. The rules in the 

proposed class select the population rr^ as better population with 

XX XX 

probability n = ptft-. + < 1 -2/3. +ft ? )— ^-- ft ? ~-') , where 

' 1 2 12 1 2 


1 »<x) 


x , 
0 . 


if x > 1 

if 0 < x < 1 

if x < 0. 
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It is shown that the restricted minimax rule in the proposed class 
is globally minimax if one of the sample sizes tends to infinity. 
It is a 1 r .u shown 1 hsi I l.hr 1 1 ««. I t it I ml mini m, t> rule possesses many 
properties consistent with the globally minimax rule and is, in 
fact, globally minimax for certain combinations of sample sizes. 
For this problem of selecting the better of two binomial 
populations we give some necessary conditions for a rule to be 
minimax in Chapter V of this dissertation. 

Recently Ambugha 1 ous and Mi esck e <1989) proved that the 
natural decision rule for selecting UEP is minimax if and only if 
= ... = n^ , a result similar to Gupta and Miescke <1986). 
They also study the properties of Bayes rules under linear and 
general monotone permutation invariant loss. 

CX) Procedures for Simultaneous Selection of Extreme Populations 
Mi shra and Dudewi cz (1987) dealt with the problem of 
simultaneously selecting two subsets and such that 

contains the LEP and S^ contains the UEP with a pre-assigned 

* 2 -ft 

probability not less than P ^ k T k-l " ) < p < O • Let the 
observations from have density f(x-0 ( ) , i = l,...,k and suppose 
that f has the MLR property. For the above goal, they propose the 


following 

procedure R. jr . . 

MU 






R MD 1 

i Select n . in 

l 

S L 

iff 

X 

l 

< 

x m + d i- 


Select ti in 

l 

s u 

iff 

X. 

l 

> 

*[k] ' d Z’ 


where dj and d^ are positive constants such that 

■nf F V CS I R md > = P © <rr (l) e S L’ ^(k) € S ul R MD ) = P ‘ 

M " • A/ 

Note that Gupta's (1965) procedure becomes a special case of 
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F*MD by taking dj = oo. It is proved that 

(.) ,nf P e (CS|R MD ) and sup E^SJ + | S u | 

^ AT ^ A/ 


R^g) occur at ©j = 


..=© k and 2kP < E 0 (|Sj + \S U 


R md ) * 2k. 


( 11 ) If e x > 9 r then P e < n j € S L |R M[) ) > P @ ( n. € SjR^) 


and P e < ir | e SjR^) > P & < n } € SjR^). 


For dj = d^ = d(say) , the lower and upper bounds on the infimum 
of P e <CS|R^p) are obtained to approximate d from the existing 


tables of Gupta (1965). Application to normal means problem with 

known and equal variances is made. For simultaneous selection of 

subsets containing LEP and UEP in the case of normal populations 

2 2 

with means , . . . ,© k and unknown variances a two-stage 

procedure similar to that of Dudewicz and Dalai (1975) is also 
proposed. Tables for applications are provided. 

Mi shra (1986a. b.c) considered some variations of this problem 
under different population models, viz, (i) simultaneous selection 
of subsets containing LEP and UEP with variances of normal 
distributions as the parameters of interest, (n) simultaneous 
selection of LEP and UEP using indifference zone approach with 
means of normal distributions as the parameters of interest, 
(lii) non-parametr i c simultaneous selection of subsets containing 
LEP and UEP when LEP (UEP) is the population with the smallest 


(largest) a-quantile. 



CHAPTER II 


Simultaneous Selection of Extreme Populations : 

A Bayesian Approach 

2. 1 Introduction 

Let Xj X^ denote k<> 2) independent random variables 

representing the populations , respectively, and suppose 

that X has a pdf f<.;©.>, 1 = 1 k. Recall that the 

populations ^ and associated with = min(©j ©^> 

and ©j-^-j = max <©j , . . . ,0^) , respectively, are called the lower 
extreme population <LEP> and the upper extreme population <UEP) . 
Mishra and Dudewicz (1987) considered the problem of 
simultaneously selecting two non-empty subsets and 

containing LEP and UEP, respectively, and gave a procedure under 
the assumption that 0 is a location parameter and f<.;©.> has the 

MLR property, l = 1 k. In this chapter we approach this 

CU 

problem f rom^Bayes ian point of view extending the results of Goel 
and Rubin <197 7) who studied the problem of selecting a non-empty 
subset containing UEP for a specific loss function. 

Let t<©> be a prior distribution on the parameter space O and 

suppose that 3> is the class of all decision rules. For the problem 
at hand the action space is 

jf = {<a lt & 2 > : a 2 c {1 k3 , a 2 c <1 k>, aj * 4>, a- z * 4>\ 

where 4> denotes the empty set. If aj = Ci j,...,ij> and 
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a^ = tjj ) m 3 . then taking an action (a^.a^) means selecting 

\n n 1 as S. and {n n V as S... 

l l l l L J m U 


Let L <0 . <aj .a^) > 

be 

the loss 

l ncurred 

in taking 

act i on 

<aj,a 2 > when & is the 

true 

value of 

parameter . 

The problem in 

general terms then is 

to find a decision rule 

6 «e £> 

T 

wh l ch 


minimizes the Bayes risk 

r<r ,6> = J J J 6((a 1 .a 2 >|x) L(0,Ca 1 ,a 2 >) 
fi X j* 

k 

[ n f(x ; e )] dr (.6 > dx 
i = 1 11 ~ 

for the given loss function L and prior distribution r, where 
dx = dx, . . .dx . Such a rule 6 is called a Bayes decision rule 
with respect to the prior t and loss function L. 

In Sections 2.2 and 2.3 we consider the case when the 
selected subsets need not be disjoint whereas in Section 2.4 we 
impose the requirement that the selected subsets should be 
disjoint. In Section 2.3 we apply the results of Section 2.4 to 
the case where the underlying distributions are assumed to be 
normal. We determine an essentially complete class of decision 
rules for finding Bayes rules with respect to a general loss 
function in Section 2.2. In Section 2.3 the loss function is 
assumed to be semi -addi t i ve and non-negative and in Sections 2.4 
and 2.5 a specific loss function is considered. 

We assume throughout that the assumptions of Fubini's Theorem 
are satisfied so that for every 6 € 3) 
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r<x ,6) = n 6((aj,a 2 )|x ) { J L(©,(aj,a 2 )> 

X jtf a 

k 

[ n f (x . ;© >] dT (© ) )• dx 
i = l 1 1 


* X l 6(<a i 

X xt 


, a^ > | x> Tj<x,<aj 


.a 2 >) 


dx , 


where 


r j ( x 


. (aj ,a 2 > ) 


= J L<e,< ai 
o 


k 

,a.) ) [ n f (X. i © )] dr (©) 
i = l 1 1 


<2 . 1 . 1 > 


(2.1.2) 


2.2 An Essentially Complete Class For Bayes Rules 


* * 

Let <aj,a 2 > e jf be such that 


Tj <x . (a*. a*) > = 


min 


<aj ,a 2 )&f 


r.(x,(a.,aJ), V x e X 

1 ^ it a/ 


where r^ < x , <a 2 , a 2 ) > is given by (2.1.2). 


Lemma 2. 2. 1 : Let t be a symmetric prior distribution on the 
parameter space O and suppose that the loss function L is 
permutation invariant, that is L(©,(aj,a 2 >) = L(g© , ( ga^ , ga 2 ) > , 

V g e G, where G is the group of permutations on (1 k>. Then 

6 given by 


<5 t ( (ga*,ga*) | gx> 


r i 

T^I 

<! ~ 

0. 


V g <E G , X € X 
x 

otherw i se 


minimizes r(T,6) over 3>, where G = Cg e G : gx = x>, and |G | 

A *v A 

denotes the cardinality of the set G^ . 
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Proof* Using invariance of L and symmetry of r we have 


> (x, (ga. ,ga,)) = f L(© , (ga. , ga„ ) ) n f(x.,-©.) dr<©> 

l ~ 1 L. J „ 1 C . II ^ 

O 1 = 


= f L<g 1 ©,(a* a*>) n f(x ,9 ) dr<g -1 ©) 

J ~ -i 4 . gigi ~ 

o 1 ~ 1 


= f L<e,(a* a*)) n f < x ;©.) dr (© ) 
J ~ 12 i=1 gii 


. -1 , * 

= Tjtg x, (aj,a 2 >> 

* * 

= Tj <x, (aj .a^) > , 


if x = gx , 


Hence, if x = gx 


* * * # 

Tj <x, <aj ,a 2 > > = r j ( x , ( ga ^ , ga^ > > 

Now, let 6 be any decision rule. Then 

r <t,<5> = n <5 ( (aj . a^ ) | x ) r^ <x , <a^ , a^ > ) 
X jtf 

> J r j <x , <aj .a^) )dx 

X 

Also , 

r(r,6 T ) = Si 6^ ( <aj .a^ > | x) Tj <x, (aj ,a 2 >>dx 
X 4 


(2.2.1) 


= J J 6 T <<ga* .ga*) |x> (x, (ga* ,ga*))dx 

X g : g«£3 


= J r j (x , (a*,a*) )dx (using <2.2.1)). 

X 

Hence, r(r,6) > r(r,6 ), V 6 6 S. - 

T " 

Let A C denote the complement of a set A. Define 

B(aj , a 2 ) = -{x € X : x^x^x for i «= . j € a 2 « l e aj n a^}- 



j<f(s,t) - -{(a^.a^) : | a ^ J = s, | a^ | = t, 1 < s,t < k> , and 
H x <s.t> = -{(a^.a^) : (a^.a^) € jtf(s,t), x e B<aj,a 2 >}. 

Let C 1 j , . . . , 1 g , t } and C j ^ , ml denote subsets of indices 
belonging to the set C 1 , . . . , k) , 1 < s, t < k - 1 and assume that the 
loss function L satisfies the following conditions : 


< 1 ) 

L (0 . (aj 

.a 2 >> 

> 0, V 

0 € O, 

V(a 

i • 

a 2 > e 

( 1 1 > 

if © j < 

V 

then 






L<0 , <a 2 

. C j j . 

. . . . J t . 

]}>> > 

L<0 , 

fst 

(a 

j * t J j * • ** • 3 £ » 1 •) ) ) 

111) 

if © < 

1 

V 

then 






L (0 , < C i 

1 

,i s .i>. 

a £ )> > 

l (0, 

fSf 

< r 

1 j i * ■ * i Jg » J 1 * a 2 ) ) 

. 

(IV) 

V 0 e O 

» 







L <0 , ( { l j , . 

... V i 

} ■ t ) 2 * • 

• ■ . j 

t* 

l})> + 


L (0 , 

Uij . 

....i s . 

)>.n r 

... i 

J t 

. ]>> 


= L <0 , < f l , . . 

A/ J- 

'••‘s' 1 


. . , 3 

t’ 

)}>) + 


L <0 , <f ij i g , J } . t ) j ) t . i > > 


Lemma 2 

.2.2 t Under 

the assumptions 

of 

Lemma 2.2.1 

, i f 

the 

densities f < , ;0 > <1 

1 

< i < k) have MLR property and 

the 

1 oss 

function L satisfies 

conditions <i> - (iv> 

of (2.2.2), 

then 

for 

any (a^ 

t & 2 ^ i ^ j « ^ 

e jfis, t) we have 





r l 

<x , <aj .a^) ) ^ 

r j ( x , (3| , &£ ^ ^ * 

V 

x € B(a^ ,a 2 > . 



Proof : 

Let ( Si « a ^ ) » 

(a'j ,a' 2 > e j4(s ,t) 

and 

suppose that 

l a 2 ° a 2 1 

= q, that is, a 2 and 

a 2 have q elements 

in 

common. Without los 

S Clf 


generality assume that 
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a 2 = 1 ] 1 ] q' J q+1 1 1 } 


and 


Let 


a 2 = {J 1 


’q' m q+l m t } 


a l = {l 1 l s 3 and a £ = ^ ) j 


We first prove that 


j q' J q +1 ’ m q +2 m t } 


r j <x , (a'j ,a"> > < <x, (a' ,a' z )), V x e BCa^a^) 

by considering the four possible cases. 

Case I : m a' 

q+1 q+1 1 

Without loss of generality assume that l .= m ,,, i = , 

s-i q +1 s J q+1 


Then 


Tj (x , <a'j , a^ ) > - Tj <x , (a'j , a") ) 


f [L<©, <a' a' >>-L<©, <a' ,a">)3 n f(x ;© >dr<©> 

c©=© J >e > ~ 1 L 1=1 1 1 

~ J q+1 m q+l 


CL<©. <a' ,a' >>-L(©,<a' a">>3 n f(x ;© >dr<©> 
} ~ 1 ~ i=l 1 1 


+ J 

C©:©. =© 

~ J q+1 m q+l 

k 

+ f CL(©, <a' a' >)-L<©. <a' a">)3 n f <x ;© )dr(©> 

C©:© J <© > " ~ i = l ‘ 1 

~ J q+1 m q+l 


Now since L is 

permutat i on 

i nvar iant 

and r 

is symmetric. 

the 

second integral 

is zero and 

roles of 

© . 

J q+1 

anc * can 

m , -i 

q+i 

be 


interchanged in the third integral so that 
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r l < ?* <a 'l ,a 2 >> " r i <x. <a; ,a">> 


i 1 * 2 


{©:© 


, > e 

) . , m , , 

q+1 q+1 


^CL(0, (a'j ,a' 2 > >-L<©, ( a' } . a" ) ) 1 


n f<x i© ) [f( x ; © >f (x 
1=1 1 ' 'q+1 'q+1 


‘^q+l.'Vl 


;0 

m , , m , . 
q+1 q+1 


> 


f (x 


; e. 


m 


)f (x 


;© >] dr (© ) . 


'q+1 "'q+1 '"q+l J q+1 

Since ] q+ j e a 2 • m q+j g a 2 anc * x € BCa^.a^), it follows that x^ 

> x . Now using MLR property and <2.2.2<ii>>, we get 
q+1 


q+1 


Tj (x. (a'j .a^,) > - Tj (x , (a' ,a"> > > 0 


V x e B(aj .a^) ) . 


Case I I * m q+ i € a r ) q+ i « a ' r 

Without loss of generality, assume that l = m ... 

s q+1 

Proceeding as in Case I and using <2.2.2 <iv)> in addition to the 
MLR property and (2.2.2 (ii>>, we get 
r i <x , <a^ , at, > > - r ^ <x , <a' ,a£> > 


C©:© >© } 

~ ’q+1 m q+l 


[ L <© , <a'j , a' 2 ) > -L <© , < a'j , a" ) ) 3 


k 

n f < X ;© ) C f < X . ;© ) f<x m ;© m ) 

1=1 J q+1 q+1 q+1 q + 1 


^q+l’Vl 


- f <x . ;©„ > f < x \B )] dr <© ) 

q+1 m q+l m q+l J q+1 


2:0, VxeBCa^.a^). 


^ 111 1 * q+1 * a 'l • "qtl « a 'l • 

Assuming I = j , without loss of generality, and 

S H + i 

proceeding on the lines of Case 1 1 we get 
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rj(x, (a'j ,a' 2 >> - <x , <a'j ,a") > 


J CL<e, <a' ,a' >>-!_<©, <a' .a">>] 

c© : © >© j 1 2 1 2 

~ J . , m , , 
q+ 1 q+1 


n f<X ;© > Cf<X > f(x^ ;© m ) 

i=l q+ 1 q+1 q+1 q+1 


^ J q+l’ m q+l 


- f<x, ;© ) f(x ;© )D dr (©) 

J q+1 m q+l m q+l J q+1 


>0, V x e B(a. , a ? ) . 

iv x c. 


Case I V * Jq+ 1 * m q+ l * a r 


Again, using the invariance of L and symmetry of t, we get 
r l^- <a l* a 2> ) - r l^- <a l’ a 2 )> 


f CL<© , <a! ,a'-> >-!_<©,< a' , a"))] 

t©:© >© ) 1 1 ~ 

~ J q+1 m q+l 


n f(x ;© ) Cf (X ;©. ) f(x m ;6 ) 

i=l 1 1 q+1 J q+1 m q+l m q+l 

^Jq+l^q+l 

- f(x ;© m > f<x ; e >1 dr (© ) 

q+1 m q+l q+1 q+1 

^ 0 , V x c Bfaj.a^). 


Combining Cases I - IV, we have 

rj(x, <a'j .a^) > £ Tj <x , <a'j ,a 2 > > 


V x € B(aj .a^ > 


Proceeding in similar fashion, we get 
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r l ( J’( a i- a 2 >> = V ?-" 1 ! V -'>1 1,'Vl m t }>> 

2 r l < J' U! l ‘s 5 ’' 1 ] >qtl' m q+2 ""t 3 ” 


2 r i < ;' (a i ‘s’- 1 ’] *t 5>> 

= r 1 < x. < a' 1 ,a 2 > > , V x <= B<a 1 ,a 2 > <2.2.5) 

Now keeping a 2 fixed and repeating the above arguments for indices 
in aj and using <2.2.2 <iii> - <iv>) we get 

r j < x , < a j • ) ) > Tj <x . <aj ,a 2 > > , V x e B<aj ,a 2 > <2.2.4) 

On combining <2.2.5) and <2.2.4), we get the result. H 

Corollary 2. 2. 1 t Suppose that the assumptions of Lemma 2.2.2 are 
satisfied. Then <a 1 <x), a ? <x>) e H <s,t) implies that 

A/ 

rj<x,<aj<x),a 2 <x))> < r^ <x , <a'j ,a 2 > ) 
for every <a' 2 «a 2 ) e jtf<s,t). 

Proof * Since (a^x), a,<x)> «= H v <s,t), implies that 

r "' 1 IV IV ^ 


x e B<a.<x), a ? <x)>, we have, by Lemma 2.2.2, 

<v * /v> 


r^ <x , <aj <x) ,a 2 <x) ) i r^ <x , <a'j ,a 2 ) ) , V<a'j,a 2 ) ej^(s.t) H 

For s,t = 1 ..... k , let 

a Cs} = fCl} Cs)}, a £t} = { Ck-t + 1 > Ck}>, 

that is, a {s} and a Ct> are subsets of indices of populations which 
correspond to s smallest and t largest observations, respectively. 
Define decision rule 6 s * ^ (1 £ s, t ^ k) as follows 


6 s * * < <a^ ,a 2 ) | x) = 


1 , if < a 2 , a 2 ) = <a Cs) ,a * 


0 , otherwise 
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Let 

D 0 = C<5 Slt , s = 1 k, t = 1 kl 

and 

k k 

S B = t<S * B : I 1 6l(a t3}' att,, l^ ■ U- 

S = 1 t=l 

Theor-em 2» 2. 1 : Under the assumptions of Lemma 2.2.2 

(i> Class Dg is essentially complete for finding Bayes rule in 

the class D of all non-randomi zed rules. 

(li) Class is essentially complete for finding Bayes rule in 

the class 2) of all randomized rules. 

Proof s <i> From (2.1.1) it is clear that non-randomi zed Bayes 

* * 

rule selects subset pair (a^.a^) w.p. 1, 
where 

r 1 (x,<a 1 ,a,>> = min r 1 <x,(a 1 ,a.>), V x e X 
1 ~ 1 2 < aj a 2 >e^ 1 ~ 

and from Corollary 2.2.1, we have 

r 2 (x, <a {s} ,a U) >> < rj (x , (a' ,a' 2 > ) , 

for all <a' 1( a' 2 > e j*(s,t>, x € X 

Hence the result follows. 

(i i ) Let & be any decision rule. Consider the decision rule <5 
defined as follows : for x e X 


l.np.RARY 

W I « - / ± \ ©i IQ 


J J 


6(<a' r a' 2 )jx>. if <a 1 .a 2 > = <a Cs} .a ct) > 


6 <(aj,a 2 >|x> = 


(a',a' 2 )d(s,t) 


s , t = 1 , . . . , k 


0 


otherwi se 
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Note that 


k k 


k k 


1 1 6 <<a Cs}’ aCt>) l? > : I J 2 6<<a lt a 2 )|x> 


s = l t=l 


s = l t = l (a^ ,a^ >€j^<s , t > 

Y 6< <a. , a. > I x> 

<a l ' a 2 >€J * 1 Z ~ 


= 1 . 


Hence <5 € 3)^. 

Also from Corollary 2.2.1, 

r l <x * <a Cs> >aCt>) ) ~ (x, <a'j ,a' ) ) , 


for all (a'a') « ^<s,t>, x e X 

± im a/ 


Thus , 


r <t ,6 > = X 1 6<<a 1 ,a 2 >jx> rj <x , <aj , a 2 > ) dx 


X (a j , a^ )gj4 


k k 


■ J 

X s 


y y i y <$< (a. ,a- > I x> r.(x, <a. , a, ) > l dx 

r 1 ^ [<a 1 ,a")e^(s.t) ~ 1 ~ 1 2 J ~ 


k k 




k k f 

•si if. I 

X s = l t = l <- <a l ,a 2 


)&#(. S , t ) 


x *. tt>. . . ft>.. . 

6 <a r T ,a > r,(x,<a r ,,a >)dx 
t s X t s } „ 


■ X 

X 


{ (aj 


<5*( (a. 


a^ 


,a 2 ) |x> r 1 <x,(a 1 .a 2 )> } dx 


= r <t ,6 > 


and the result follows. 



2. 3 Sftnil ~addi t.1 vs and Non~nGgati ve Loss Function 


For, 1 , j - 1 k, let t (©) be a non-negative function 

i i ] ~ 

on the parameter space Q satisfying the following conditions 


( 1 ) 

l 

gi 



. V g 

(11) 

e 

> e . ==> 

l (©) < 

t , (©) 


) 

) 

i . J ~ 

l . }' ~ 

(111) 

e 

> e , ==> 

l . (©> < t. (©) 


i 

i 

i , ) ~ 

l . ) ~ 

( i v) 

z 

(©) + i 

.(©) = l 

(©) + l 

Let 

i , 

i ~ j , 

) ~ i . 

k 

) ~ ) 


r 

(x) = r t 

(©) n 

f (X, ;©. > 


i * J 

~ j i 

o 

’ 1 ~ i=i 

i l 


( 2 . 3 . 1 ) 


Lemma 2» 3. 1 : Suppose that the pdf's f(.;0 ), l = 1 k possess 

MLR property, prior distribution r is symmetric on Q and t. .'s 

1 » J 

satisfy (i) - (iv) of (2.3.1). Then 


r. ( x ) > r . , . ri -(x). 
l , j ~ Cl } , Ckl „ 


Proof * Let L be a permutation invariant loss function which 
satisfies conditions (2.2.3) and is such that for i.j = 1 k. 


L(©. (Ci>, C )}>> = l. . (©) . 

~ 

Therefore, on taking s = t = 1 in Corollary 2.2.1, we have for any 

i,j — 1 ..... k 


r (x) 
i . J ~ 


k 

r l . (©) n f (X. ;©, ) dr (0) 

J 1 . J ~ > _i 11 

n 1 

k 

J L(0. (Ci>. {]})) n f(x l ;© l ) dr (0) 
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k 

> J L<©,(C{l}},CCk}})) n f<x. ; e.) dr<0) 

^ j It w 

O t_i 

* J" 'cn.ck> < !> f< W *■<!> 

O C ~ 1 

= r a}.ck> ( ^- ■ 


Let /?< 1 , j ) be a non-negative function defined on IN xlN, where 
[N denotes the set of natural numbers. For the problem of 
simultaneously selecting two non-empty subsets and 

containing LEP and UEP. respectively, consider the loss function 
defined by 

k k 

L<©,<a 1 ,a 2 >) = /?<|aj| . |a £ | > J J * lfJ <©> (2.3.2) 

i€a } jea £ 


Jp<KI. l-*l> 1 l 

Q iea. ]ea ? 

k 

n f (x, ) dr <0 > 

1 = 1 L L 


- l I r i., ( ; > - 

iea j )€a 2 


Lemma 2.3.2 t Under the assumptions of Lemma 2.3.1, 

r^x.dtlJJ, CCk>>>) < r 1 <x.<a 1 .a 2 )>. V (a r a 2 > e * 
provided st /3(s,t) 2 f?<l,l), s,t = l,...,k. 


we have 

r j < x , (aj ,a 2 > ) = 
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Proof * Suppose (aj,a 2 > e j*(s,t>. Then 

Tj (x , (aj ,a 2 > ) = ft(.s , t> 2 2 r i j <x> 

i€aj jea 2 

* st /?(s,t> r {1} j ( x > (Using Lemma 2.5.1) 

> / ?<1 > 1>r cl}f{k> <^> 

= r 1 (x,<C{l}},C£k}}> m 

Suppose Y x = X [i;j , Y = (Y x Y k > e 5/ = £y : yj < y £ < . . . < y k >. 

Then, as a consequence of Lemma 2.5.1 and Lemma 2.5.2, we have 


Theorem 2. 3, 1 t Suppose assumptions of Lemma 2.5.2 are satisfied. 
Then r(r,6) is minimized in 3) by 6 given by 

T 


6 T <<Cgl}.Cgk>) |y> 



, V g e G y , y e y 
, otherwise 


(2.5.5) 


where G = Cg e G : gy = y>. 
y <v 

Proof : By Lemma 2.5.2, it follows that (aj,a 2 > = < C Cl > } , C Ck3 } > 
minimizes r^ (x , (a^ , a 2 ) > over (aj,a 2 > e . Hence, if X = y is 

observed then an application of Lemma 2.2.1 proves the result. 


Remark t For x € X, <5 is defined as : 

^ T 


<5 ((a,. a,) x) = 6 ( ( ga. , ga 9 > I y > if and only if gx = y. 

T 1 L „ T 1 L ' „ ~ ~ 
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Let 

R(0,<5> = J | J 6<(a r a 2 )|x> Lte.Uj.a^) 

X (aj ,a 2 >€^ 

k 

n f (X ;© > dr ( 0 ) dx 
1=1 11 ~ 

denote the risk when decision rule 6 e S is used and 6 e O is the 

true value of the parameter. Also, let 

5)^ = C6 e S> : 6<<aj,a 2 >|x> = 6( <ga^ , ga^) | gx> , 

V (aj.a^) e , x e X and g e Gl 

denote the class of all permutation invariant decision rules. 


Lemma 2. 3. 3 I Suppose that the loss function L is permutation 
invariant. Then 

R< g© , 6 ) = R(0 ,<5 ) 


for every © e O, g e G, and 6 e . 


Proof 1 * 


R< g© ,6 > 



6<<aj,a 2 >|x>L<g©,(aj 1 a 2 ))J' 


n f<x ;© . ) dx 

i=l 1 g’ 1 ! ~ 


= J J y 6( (a^ .a^ ) | x >L(© , < g ^a^.g 1 a 2 >) 

xk*i'*z )e * k ~ 

n f <Xj ;9 _j ) dx 
i=l g 1 i 


(Since L is permutation invariant) 
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<5( ( g ^a 1 




-1 

9 a. 


> | g -1 x>L<© 


, -1 
<g a. 


9 1 a 2 >) 


} 


k 

n f <x ;G . ) dx 
1 = 1 g i 

( S i nee <5 e 3 ) ^ ) 



6 ( (aj ,a 2 > 


g _1 x)L(e 


(a. 


,a 2 >> 


} 


n f <x . ; e. >dx 
i =1 91 1 ~ 


= f | y <5((a.,a,)|x)L« 1 (a lt a,))] n f(x. ; ©.)dx 

x 12'- - 12 J i = 1 i > - 


R<e,«5> . 


Theorem 2. 3. 2 t Suppose that the pdf’s f < . ;© ) , l = 1 k 

have MLR property and loss function is given by (2.5.2) with 
l t ^ s satisfying properties (i> - (iv) of (2.3.1). Then for all 
& e Cl and 6 € ZD 7 

iv A 

R(©,<5 ) < R(©.<5) 
where <5 is defined by (2.3.3). 

T 

Proof t Clearly 6^ € . Fix 9 e O and let r be the probability 

distribution on O which puts mass on each permutation of fixed 
e e D. Then clearly r is symmetric and hence from Theorem 2.3.1. 


we have 
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However , 


r(r ,6 t > < r <t ,6) , 
i f <5 € 3)j , then 

r(T ' 6> ’ TE 2 R<9 ! 


geG 
= R<©,6> 


V <5 € to 


,<5> 

(using Lemma 2.3.3). 


Hence , 


R(0,<5 > = r(r,6 > < r (t ,6 ) = R<e,6>, V <$ € 2> r 
~ T - 1 H 

From the above theorem we conclude that S is both minimax and 

T 

admissible with in the class ^ of permutation invariant decision 
rules. Since the group of permutations G is finite, it follows 
that <5 is both minimax and admissible in 3). 

T 


2. 4 Bayes Rules When the Selected Subsets are Required to be 

Disjoint* Specific Loss Function _ ^ ' 

1<W Ajs-'b*- tU4" tke, Uc? tWe, U fcp c 

8Lo nsj_de r _t he goa 1 of simultaneously selecting two non-empty 

XvoyrwA-. TKm?, vtC'Vma^' 1 

and disjoint subsets and S^j containing LEP and UEP 

respectively, using Bayesian approach. For the above goal our 
action space is given by 


sf ^ = -{(a^.a^) : c Cl,...,k}, a^ <= £1 kl , 

aj * <p, a z si <p, aj n a 2 = 4 >\ , 

k k+1 

which contains 3 - 2 +1 elements. Suppose that the loss 

function is given by 


L<©,(a 1 ,a 2 >> = Cj |a } |+c 2 |a 2 |+c 5 <min e i ~ e cn ) 


iea. 


I €E 2 

where ^ > 0. l = 1,2, 3, 4, are some constants whose 


(2.4.1) 

re lat i ve 
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values indicate the relative weights given to the four components 
of the loss function. 

Since we are interested in finding Bayes rule, it is 
sufficient to consider only the non-randomi zed decision rules. 
The following lemma reduces the number of decision rules to be 
compared from - 2 k+ * +1 to 1 - . 

Lemma 2.4.1 x Suppose that the pdf's ft.;^), i = 1 k have 

the MLR property and the prior distribution r is symmetric on Cl. 
Then 

s t 

min r <r,6 ' > = min r(r,<5) 
l<s.t<k-l 6eD 

2<s+t<k 

where 6 s ' * (1 < s , t < k-1 , 2 < s+t < k> is given by 

. f . ft} 

1 , if = a £ s } ancl = a 

<5 S * * < (a^ , a 2 ) | x) = h] 

0 , otherwise 

Proof x Consider <s.t)-th decision problem where action space is 
j* d <s,t> = C<a lf a 2 > : <a 1 ,a 2 > e^.lajl = s,|a 2 | = t>. 

1 < s.t < k-1. 2 < s+t < k. 
For s+t < k with the observation vector x, the action space 

. ( s , t ) and the loss function given by (2.4.1), (s.t)-th decision 
a 

problem is equivalent to partitioning the set Cl ... . ,kl into three 
disjoint subsets y ^ , y^, and y^, where y^ is of size t, y ^ is of 
size s and y 2 is of size k-s-t . Conditions of Eaton's (1967) 
pape r are sat l sf l ed and thus the rule which ass i gns C Cl Csll 
to y^, C Ck-t + 1 > Ckll to yj and CCs+1 J . . . . , Ck-t>} to j" 2 is 


Bayes . 
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For s + t - k, ( s , t > -th decision problem with the observation 
vector x, the action space ^ ( s , t ) and the loss function given by 

(2.4.1) is equivalent to partitioning the set Cl k> into two 

disjoint subsets y j and , where y ^ is of size t and y ^ is of 

size s = k-t. Again the results of Eaton’s (1967) paper are 

applicable. Hence the rule which assigns CC1> Cs>> to y ^ and 

CCs + 11 Ck)} to y j is Bayes. Thus 

r(x,6 S,t ) < t(t,6), for all 6 e D(s,t) 

where D(s,t) is the set of all non-randomi zed decision rules 

corresponding to the action space jtf^s.t). Hence Bayes rule is 

s t 

one of the decision rules 6 ' , 1 < s,t < k-1 , 2 < s+t < k. 


Remark * Lemma 2.4.1 holds for any loss function which satisfies 
the conditions of Eaton’s (1967) paper. 

Define 

A g (t) = r 1 (x,(a {sJ ,a )) - Tj (x . (a ts ^ ,a )). 

t = 1 , . . , k-2 , 2 < s+t < k-1 


and 

A*(s) = r i ( ^ <a cs + l}’ a£t)>> ' r l < ^’ <a Csl’ a >>f 

s = 1 k-2. 2 < s+t < k. 

The following Lemmas 2.4.2 and 2.4.5 further reduce the 
number of compar i s i ons to be made for finding Bayes rule. 


Lemma 2. 4. 2 s Under the assumptions of Lemma 2.4.1, 

(l) A (t> > A (t-1). t = 2 k-2. 2 < s + t < k 

s s 

(li) A*(s> > A*(s-1), s = 2 k-2. 2 < s+t < k. 
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Proof * <i> A (t) = r.(x,(a _Ct+l> 


Let, 


1 ' a {sl 


b c = rrun C© C1} ©,^1. 


.a 


)> - 


r l ( ? ’ <a ts) ,aCt>> * 


Cs}' 


b = max te ck _ t + 1} 0 {k} }, 


A, = (& -.9 


a„ = {.e : e 


A, = W : B 


Ck-t> 


> bS 


Ck-t+1 > 


> b^ 1 } 


Ck-tl 


> b*" 1 ! 


and 


B = W s e 


Ck-t+1 ) > 0 {k-t} } ‘ 


Then 


t + 1. 


A <t> = f (c 1 s+c„(t + l>+c,<b -© ri ,)+c. (© ri>1 -b'"'>) 
S J 1 L JsLlJ 4 Ik j 


n 


n f(x ;6 >dr(0> 

1=1 


-J <c 1 s+c 2 t+c 5 <b s -© [i:| )+c 4 (0 [k;] -b t )) 

o 


n f (x ; 9 )dr <©> 

i=i 


= c, f n f <x, -,e, >dr<e>-c, f <b t+I -b t > n f<x ,e >dr<e> 
Q‘-‘ - o 1=1 - 

= c 2 J n f<x li e ! >dr(e)-c 4 J» {k _ t j-b*) n f < Xl ,e t >dr <e> 

A i-1 A i-1 


<Since outside A^ , b^ + ^ = b^> 


t-1 


A s (t) - A s (t-1) = c 4 f <e {k . t+JJ - b ) ^ dr<e) 


- *=4 f le (k-t5 - bt> £ f< *i’ e i> <*<?> 
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“ c 4 I <e £k-t+l> 
A 2 


t-1 * 

b ) n f (x ;© ) dT <©) 
1 = 1 


" C 4 I <€> {k-t> 


t-1 

b > n f (x. > dr (©> 

1=1 1 L 


(Since b 1 1 < b l ) 


- c 4 X <S {k-t+l } 
A 2 


t-1 

b ) n f (x, ;© > dr (©> 
1 = 1 L L 


c 4 X <0 {k-t} 
A 3 


t-1 

b > n f < x , ; © > dr (© ) , 
1=1 ‘ 1 


(Since Aj <= A^ ) 


[ X 


A £ nB 




+ J <e ck-t + i>- bt ' 1> , n , f( W dT( ! > 

A 2 nB c !=1 


t-1 


- I (e tk-t}- b f < v e i >dT< ! > 


A ? OB 


1 = 1 


- f f<> W *•'!’] 

. _ „C 1=1 J 


A ? nB 


On interchanging the roles of ^^-t} an ^ ®{k-t+l} ln ^ nc * ancl 


Integra 1 , we get 



6 } 


A (t) - A <t-l> 
s s 


* c 4 J <® 


Ck-t+i } 


t-i 

-b x A > n 


a 2 ob 


1 = 1 

i^k-t , k-t+1 


f <x ci 3 ;0 u 


Cf <x [k-t] :0 Ck-t} )f <x £k-t+13 ;6> Ck-t+l } } 


" f < *Ck-tr e tk-t+i> >f< *ck-t+i:r e <:k-t> >:ldT< ? > 


c 4 J <e 

Ay~>B 


(k-t) 


t-1 

■b ) n 


t = i 

l*k-t, k-t+1 


f (x [l 3 ' e u y ) 


Cf <x Ck-t] ;6> Ck-t} )f <x Ck-t+13 ;0 Ck-t+l} > 

“ f <x [k-t3 ;e {k-t+l> )f <x [k-t+13 ;e Ck-t} >:idT< ® > 


- c 4 X <e fk-t+ii“ b ) n 


A £ nB 


1 = 1 

l*k-t , k-t+1 


f(x ci 


Cf <x [k-t] ?e ck-tl )f <x Ck-t+n ;0 Ck-t+l} > 

“ f <x [!k-t3 :e Ck-t+l} )f <x Ck-t+13 ;e {k-t> >:idT< ? > 


A 2 nB l*k-t, k-t+1 


f<x ci3 ;e ai > 


Cf <x [k-t] ;0 Ck-t> >f<x Ck-t+13 ;e Ck-t+l> ) 

* f <x Ck-t3 i0 Ck-t + l> >f <x Ck-t+13 ?e Ck-t> ):,dT< ? > 


(Since A, n B c A ? n B) 
k 5 L 


= c 4 X <e Ck-t+l > _e Ck-t} J , n 


A £ nB 


1 = 1 

l*k-t, k-t+1 


f<x ci3 ;e a> > 


Cf <x Ck-t3 50 (:k-t> >f <x Ck-t+13 ,e Ck-t+l> > 

" f <x Ck-t3 ;e Ck-t+l > >f <x Ck-t+13 ;e Ck-t3 >:idT< ? ) 


Now using MLR property and the fact that ®{(<-t+l> ^ ^Ck-tJ ^ or 


© e B, we get 
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A (t) - A ( t-1 ) > 0 

o S 


( i i ) Let 


B 1 = 

W 

A/ 

: e Cs+l> 

< b } 
s 

II 

CD 

19 

A/ 

: < 

b s-l } 

ll 

KN 

CD 

C9 

: e cs+n 

< b s-l } 

D = 

W 

: e cs+i> 

> e (s> 3 


Then , 


A t <S> “ r l ’ <a Cs+l} ,a >J ” r l < ?’ <a Cs> ,a >} 

k k 

= c. f n f (x, ;0, )dr(©> + c , f(b , , -b ) n f (x, ,9. >dr (©> 

1 J l = i 1 1 ~ 5 J s+1 s i i 

O O L 1 

k k 

= c, f n f (x, -,e, >dr<e>+c, Ue r ^..-b > n f <x, -,e. >dT <e> 

1 J , , L i „ 3 J Cs + 11 s , , Li 


(Since outside B. ,b ,, = b ) 

1 s + 1 s 


Therefore , 


a*(s)-a*<s-i> = c, f (e ts+n -b 5 > [ n j f<x l! e [ )dr<e> 


r (9, - -b . > n f (x, i 9. )d T<e> 
J (si s-1 i l 


2 <=, X <e u + n- b 8-i > , n , f(x r e i >dr< ! > 


- c„ r <e. ,-b ,> n f(x , ;9 >dT<e> 

B ' S5 S_I ‘ 1 " 


> b > 
s-1 s 


(Since b 
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* c 3 f <6> 


B. 


ls+iy~ b s-i > n f (x ? i®, >dr<©> 
i = l t 


- c 


r k 

3 J <0 Cs>“ b s-l > n f <x, !©, >dr(©> 
B. i=l 1 1 


<Sinc e B, c B, and e [s+J) < in B] and B > 


= c 


3 [ ^ <e C8 + l>" b 8-l > 11 f<x i 

B ? nD 1=1 


K 

+ J <0 C8+l>" b 8-l > n *<v 0 i >dT<0) 

B ? nD c 1=1 

r k 

J ^{ s }~ b s _ i > n f < x t je ^ drt ©) 

B 2 nD 1=1 

r k 1 

J „ , n , f< VVdT <e> 

i nn c i= l ~ J 


B 2 OD 


On interchanging the roles of © fs} and e fs + 1} in 2nd and 4th 
Integra 1 . we get 


A*(s> - A*(a-J> 


- C 3 J" < ®{B+lJ- b a-l ) n 


B^nD 


1=1 
i^s , s+ 1 


[13 ,S U} 


Cf <X Csl !e Cs> >f <x Cs+13 ;e {s+l> > 


-f (K r __ ;9 


Cs] ;0 Cs + l} >f <x Cs+U ;0 {s} > 3,1,7 < ? > 


- c 


3 J" <e Cs}" b 8-l > ”, f<X Cl3 !0 a} > 

B z nD 


Cf <x cs3 ;0 <:s} >f <x cs+ir 0 {s+i> > 


_f <x cs3 ;0 cs+n >f <x ts+ir e ts> >:,dr< ? > 



66 


* c 3 J ,) 


B 2 nD 


(s + 13 s -1 


k 

n 

1=1 

l*s , s+1 


f<x [l 3 


Cf <x Cs] : 0 Cs 3 >f <x Cs + l] ' ,e C 5 + l> > 

“ f <x Cs] ! 0 cs+n >f <x [s+n ; 0 cs} >:,dT< ® > 


- c. 


I <e ts}‘ b «-i > ", f< x t ir e a>> 

L - 1 

l*s , s+1 


B 2 nD 


Cf <x [s3 ; 0 Cs> >f <x [s+13 ! ®Cs+1> > 


" f <X Cs 3 ; 0 {s+ 13 )f <x Cs+ 13 ; 0 Cs} > ]dT< ® > 


(Since B, n D <r B, n D and b . > 6 . , in B, n D and B, n D>. 

c > s -1 t s } Z > 

Now using MLR property and the fact that 6 r , . - < B r in 

15+1/ 1 S / 


B 2 n D , we get 


A*(s) - A*( s- 1 ) > 0 


Not-e * A s <t) is independent of s and A^(s> is independent of t. 
In particular, 

A (t) = A ,.<t) , 1 < s < k-2, 2 < s+t < k-1 

s s + 1 

and 

a;<s> = a; +1 (s> , 1 < t < k-2, 2 < s+t < k-1. 

Let 

Fj = Ct : Aj ( t > > 03 

and 

F 2 = ts : A*<S) > 0). 

For Fj * <f>, and F 2 * 4>, let m and p denote the smallest integers 
in Fj and F 2 respectively. Following theorem further reduces the 
number of integrals to be evaluated for obtaining Bayes rules. 
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Theorem 2. 4. 1 * Under the assumptions of Lemma 2.4.1, the Bayes 

& # 

rule selects subset pair (a^.a^) with probability one, where 

r, (x, <a*,a*> > = min r. <x , <a r . , ,a Ck “ 1 } ) ) , if F. = , F 9 = <p 

1 ~ x l l< i<k-l 1 ~ ^ 1 3 1 L 

= min r.(x,(a riV a {k ‘ l} )), if F. * <p, F 9 = 4> 
k-m< i<k-l 1 ~ 1 c 


f k- i > 

= min r.(x,(a r ,,a >), if F. - <p , F ? & <p 

1 < 1 <P 1 ~ 1 1 * 1 c 

- Tj <x , <a^ p j ,a^ mJ > > , if Fj ^ <p, F^ * <p, and m+p ^ k 


= min r.(x,(a f ,,a^ *^>>, if F. ^ <p, F ? sf 4> 
k-m<i<p 1 ~ 

and m+p ^ k+1 

<2.4.2) 

Proof * In view of essential completeness of non-randomi zed 

decision rules, it is enough to show that 

r.(x,<a* a*>> = min r } < x , (a-j , a £ ) ) 

1 ~ 1 <a 1> a 2 >e^ 


Case I : Fj = <p , F^ = <P 


F 1 = 


-> Aj<t) < 0. t = 1 k-1 

■> A < t ) < 0, t = l t ...,k~s~l, s = 1 , • . . , k-1 
s 

(Since A g (t> = A s+ j(t>> 


— : > r i^* <a cs}* aa>>> > r i^’ <a fs> ,at2>>> > ••• 


> r j ( ;’ <a c s j- a n - 


s = 1 k-1 


Similarly F^ = implies that 

Ct>. 


Ctl. 


rj<x,<a^j^,a >> > r i** , * a C2) ,a ^ ' 


, CtJ,, 

> r l ( ^* <a Ck-t}’ a >> ' 


t = 1 k-1 
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Therefore Fj = <p , F 2 = <p implies 

r l (x, <aj ,a_) ) = min r. <x , <a. ,a.) ) 

(a 2 ,a 2 >€jtf ~ 1 L 

- min r. (x, <a f ,a Ck ' 1> )) 
l<i<k-l 1 ~ 113 

Case II t F j * <p , F 2 = <t> , m being the smallest integer in F ^ 

Fj * <f> implies that 

A 2 <t) <0, t = 1 m-1, and AjCt) >0. t = m k-2 


which in turn implies that for s = 1 , . . . ,k-m-l 

A <t> < 0, t = 1 , . . . ,m-l , and A (t) > 0, t = m k-s-1 

» s 

Therefore , 


Cl> 


C2> 


Cm} . 


r 1 (x,(a {s) ,a )) > r, (x . (a f ^ .a c ) > >...> r,(x,<a,.,,a )) 


i:’fs} 


1 2’ Cs} 


and 


/ / Cm} . v , Cm+1}.. . 

r.(x,<a, ...a )) > r.<x,(a, ...a )) > ... 

1 ~ vs} 1 ts} 


x , , Ck-s}.. 

> r. <x , <a r ,,a )), 

1 ~ Cs) 


for s = 1,..., k-m-1 


But, since F^ = <f> , we have 

Ct} 


r^ <x , Ca^ 2 y ,a l ) ) > ... > (x , (a^ k _^ ^ .a^^ > ) , t = 1 


,k-l 


Hence , 

* # 

r. <x, <a. ,a_) > = min r, <x , (a. ,a ? > ) 

1 ~ 1 C (a 1 ,a 2 )ea ~ 

= min r . (x , (a f . ,a^ k 1 "* > ) 

k-m<i<k-l 

Case III * Fj = <p , F ^ * 4> , P being the smallest integer in F^ . 
Now F^ * <p, implies that 

r 1 <x.<a a} ,a {t:> )) > r 2 (x , <a {2} ,a Ct5 > > >...> r 2 <x , (a {p) ,a Ct> > ) 


and 


r i < ^ ,<a c P } ,aCt>>> < r i < ^’ <a c P +n’ aCt>>> < ••• 


, , Ct}., 

< r l ( ^ <a Ck-t}’ a >> ’ 


for t = 1 k-p-1 . 
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But since Fj = <p, we have 

Tj <x , <a Cs j ,a f 1 } ) > > ... > r j (x. <a Cs} ,a Ck-s> >> , s = 1 k-1 . 

Hence . 

# * 

r. <x , <a. ,a*> > = min r. < x , (a. , a 2 > > 

1 (a^ ■ 

, . tk- l > . . 

= min r, (x, (a. . , ,a >> 

i<,< P 1 - ti} 

Case IV : * <p, f^ * 4> , m and p being smallest integers in F^ 

and F 2> respectively 


F 1 * 4> — > 


r r l( *.<a (s} .a UJ » > 
■j and 

/ / tml.. ✓ 

r 1 <x,<a {s} ,a )) < 


v , , Cm}.. 

> r i'? ,ta isr a n 


v r / (k-S),. 

< r l^- (a Cs}' a }> 


f 7 * 4> = = > \ 


. / ct>,, s 

r^x, (a tl ^,a )> > 
and 

r l ( * ,<a Cp> ,a }> < 


for s = 1 k-m-1 

x , , It!.. 

> r, <x , <a , , ,a ) ) 

1 ~ tp j 


„ x , ft),, 

< r 2 > <a Ck-t} ’ a /} 


for t = 1 k-p- 1 


Therefore . 

r.(x,(a!,a!)) = min r j (x , <a^ , a^ > > 

1 ~ 1 L <a 1 ,a 2 >€a 

r r 2 <x, (a {pJ ,a {m} ) ) . if m+p £ k 

min rj<x,<a {ij .a tk ' l3 >). if m+p > k+1 
k k-rnS i<p 


Note * Goel and Rubin <1977) dealt with the problem of selecting 
a non-empty subset containing UEP. using Bayesian approach. For 


the loss function given by 
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Li<©,a) = c 2 |a| + c 4 <e [k] - max © > 

iea 1 

(where c £ > 0. c 4 > O.and a c Cl k>, a * 4>) they derived 

non - random i zed Bayes rules. Similarly one can obtain Bayes rules 

for selecting a non-empty subset containing LEP when the loss 

function is given by 

l_ 2 (©,a> = Cj | a | + c_ (min © - © ) 

lea 1 

where c } > 0, c £ > 0 , a c Cl k), a * <p. Note that for the loss 

function L(0,(aj,a 2 > = Lj(0,aj) + L^CS.a^), the separate solutions 

of above two problems give non-randomi zed Bayes rules for the goal 
of simultaneously selecting two non-empty subsets (not necessarily 
disjoint) containing LEP and UEP. Therefore, with the specific 
loss function considered in this section, if the subsets are not 
required to be disjoint, the trivial solution is to use Goel and 
Rubin (1977) procedure separately for selecting LEP and UEP. 


2. 5 Application to Normal Distribution 


Suppose that, given ©j © k > the random variables Xj,...,X k 

are independently normally distributed with means ©j © k « 

Ttve •U^vvJkA'vow ~ L MtWcwa.cjj, Co yii~. 

respectively, and a common known variance a, ^Further assume that 

©,,...,©. are independently and identically distributed normal 

1 l\ 

2 

random variables with mean and variance ? . Thus, here we have 


f»vV -b* 

1 k 
dT(©> = — n 

? n i = 1 

and Ci = X = lR k , the 



k-dimens l onal Euclidean space. 


Let m(x) 

A/ 


denote 


the marg l na 1 pdf of K = ( X j . • • • » X k ) , that is 
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m<x> = f n f < x ;0 ) dr (© ) 

~ o 1=1 1 1 


so that , 


A <t> 

m( x ) C 2 “ C 4 E(<0 £k-t)" b } 


t = 1 k-2 


2 < s+t < k 


a;< s > 

m( x > 


= Cj - c 5 E(<b s -e {s+1} ) + |x=x), 


s = 1 k-2 


2 < s+t < k 


where , 


z , if z> 0 


0 , otherwise. 


Now, given X 


x, the random variables } • • • • * e ck> are 


independently distributed with 0^^ <1 ^ l S k> having a normal 
d l str l but l on with mean a ^ ^ — ■ g— + V and the var i ance 

1,2 = h'p] ’• 


Lemma 2.5.1 * Under the above set-up 


A <t) 
s 

m<x> 


c„ - c 


Pi . n 


i =k-t+l 


$(z + — I — L) $(-z)dz 


t = 1 k-2. 2< s+t < k 


< i i ) 


A*(t> 

s 

m(x) 


= c. - c,r> J n 

1 5 J 1=1 


s a i~ a s+l 

n *(z + 1 > «(-z>dz 


s = 


1 k-2, 2< s+t< k 
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Proof t <i> Let Zj Z k denote k independent standard normal 

variates. Then for X > 0 . we have 

H<X | x) = p<<e Ck _ t} -b t > + > X|X = x) 

= P< e Ck _ t) > X + 6 {l} . i = k-t + 1 k | X=x> 

= P(Z k _ t 7} + a k _ t > X + Z ] 7) + « ]t i = k-t + 1,..., k) 


oo , 

k "k-t'", X 

= J n $<z + — -) 4 >{z + dz 

i=k-t+l 
-oo 


r> ’ v 

Me know that for a non-negative continuous random variable X with 

distribution function F^ 
oo 

E < X > = J Cl - F x <x>>dx 


-oo 


Hence , 


oo 


E< < e Ck-t} -t)t> + l X = = J H(X I^ } ^ 


CO 


= 7? J n 

i =k-t+l 
-oo 


a k-t~ a i 

$<z + K , — -) $(-z> dz 


and 


oo 


A (t) k 

5 = - c.„ X . n 


m( x> 


-oo 


i =k-t+l 


“k-t" 04 ! 

$(z + JL1 — L) $<- Z )dz 
77 


(11) Application of < l ) on W, = -X, yields the required result 


Define , 


oo 


j <z) = f S m Cz+u> 4 (-u)du 


-oo 

Note that 3 <z> is an increasing function of z and a decreasing 
m 


function of m. Also 
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oo 


Jj(0) = J" $ < u ) $ < -u >du 


-oo 


Integration by parts gives 

1 


Jj(0) = 


Vtt 


Lemma 2. 5» 2 * For t = 2 < s+t < k, 

a. -a 


c 2 - r) min 




and 


A (t) 

< < c - c 

m< x ) ~ 2 4 


^t(^) 


a, . -a, 


^ f k-t k 1 

* J tl — — J 


a, -a. 


c, - 


A*< t > 

“ m<x) ~ C 1 " c 3 


A <t> 
s 


t N + , 


Proof : = c 0 ~c,. E((© r _ x> ~b ) |X = x> 


Y*<x> 2 4 ' {p-t} 


> 

C 2 

" C 4 

<D 

i 

rS 

1 

CD 

s/ 

UJ 

Ck) 




CD 



r: 

C 2 

- C 4 

; 

0 

p<e ck-o 

> : 




00 

r 00 , 


= 

C 2 

“ C 4 

J 

J J *(z 

+ 




0 

V. -Q0 





7? 

CD 

J *[z + 

^k 


C 2 

‘ C 4 






-00 





5 ( -z>dz 


f a k-t"°Vl 
77 J i l —T—\ 


~ c 2 " C 4 


dX 


(2.5.1) 
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Also from <i) of Lemma 2.5.1, we have 

A / 4- \ 00 


A (t) 
s 


_ K a. , -a 

C 2" C 4 * S n *(z + 

i=k-t + l 


> $(-z)dz 


Therefore , 


« k -t- a k-t + l 1 . V U 


C 2 - C 4^t(— V t + 1 ) 


£ 4 H V J ~ m(x> 

* Ci. , “Ot. v 

5 C 2 ' C 4 ” J t ( ) 

From (2.5.1). and (2.5.2), we obtain 


(2.5.2) 


C 2 _C 4 ^ min 


Simi lar ly 

c r c ? 


[j 

r i j 

f “k-t^k-t+l 

l 1 1 

L rj J’ J t 

L » JJ 


A (t) 

- GL 

m(x) ~ C 2 C 4 * 3 t [ — J 

(J. I 

r 1 '^ 1 1 . j 

a. -ot 
s s+1 

1 | 

L 17 J s 

17 JJ 


<A. (s) < c. - c. r? J 
t 2 4 ' s 


Theorem 2. 5. 1 s Let (a^.a^) denote the subset pair selected by 

C 1 C 2 

Bayes rule and suppose that > J (0), and > 0,(0) for some 

c y 0 s c^tj t 

s.t e £l,...,k-2). Then |a*| S s, j a^ | - t, and |a*| + |a*| < 

min (s+t,k>. 

Proof j Since J^z) is an increasing function of z and 
a ] - a < 0 for l = 1 k-1 , it follows that 


> J (0) > J 


CyO S 


( a -a . . . 
s stl ] 

17 J 


and 
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-4- £ j. <o> > 3 f ak -t+i ] 

C A T) t t l 7? J 

which imply that A ^ ( t ) ^ 0, and A^(s) ^ 0. Thus from Theorem 

2.4.1, for some m £ t, and p < s 

r l <a l ,a 2 > } = r l <x,<a Cp} ’ a<,m,>> ' lf m+ P - k 

and 

r.<x.(a* a*)> = min r.(x,(a, , a Ck ” 1 } > > , if m+p > k + 1 

~ k-m< i<p 1 ~ tw 

which proves the required result. 

■ 

Values of J^O) are tabulated by Goel and Rubin (1977) for 
var l ous l ' s . 

f C 1 C 2 T 1 

Corollary 2.5.1 * If min I , I 2: — , then the Bayes rule 

I cy? c 4 t) J ^ 

selects the subset pair <CC1>}, CCkll) with probability one. 

C 2 1 ^1 1 

Corollary 2.5.2 * Suppose i — , and .2821 £ — — < — . then 

c 4 7 ? yjf C 3 17 VnF 

the Bayes rule selects subset pair ( C C 1 } ) , { Ck } 1 ) if oi^ ^ 

+ j” 1 f —I— I , otherwise it selects subset pair (tClll, C2>1, 

1 t c 5 t? J 

Uk}}> . 

C ? 1 

Proof s > — = = > A- < 1 ) ^ 0. 

c 4^ vs 1 

From Table 2 of Goel and Rubin (1977). we have J 2 <0> = .2821. 
Therefore 

— L_ > .2821 = J,<0) ==> A*<2> > 0 

CyT) 2 1 

Hence by Theorem 2.5.1 and Lemma 2.4.1, Bayes rule either selects 
subset pair (Cfl)). Uk}}> or selects pair (CU>. C21>, CtkJl). 

But subset pair <CC1J. CCk>>) is selected only if 



76 


4t f a ] O -v 

V” = c i - c > ’ J i [ — ] 2 <=■ 

that is, only if 


a < a * n j " 1 f IL. ] 

1 2 1 l. c ? r? J 

and the result follows. 


k-m 


a.. 


P+1 


: s 

For m,p 

= 1 k-1 , 

suppose 



max 

K + » 

j-i r!i_i 

/N i. 

j-1 

f — 11 

1 l c 4 t > J ' 

k-m+1 + 17 

J 1 

l c 4 >? JJ ’ 

> a k 

+ Y) Jj 1 





m i n 

i /V - V\ 

j-i r fi_ } 

ot - r) J * 
P P 

f ! 

I_ 11 and 

111 I if 

1.1 17 

1 l J * 

1 c 

JJ ’ 

> + ^ 

J-l f 





P-1 l 

J ‘ 





Then Bayes rule selects subset 

pair 

* # 

<a 1 ,a 2 > given 

where J *(z> = -oo, 
o 

and a = -oo. 

0 



Proof : Conditions 

< i > and ( l i ) 

imply 

that 

C^-c^ r) min ^3 

f ol k-m~ a k 1 

3 f 

“k-m^k-m+l ^ 

1 l V J 

’ ", l 

V JJ 

V C 4 " Vl ( 

a k-m+l ~°*k 1 

< o, 


, » J 


Cj-Cj 17 min 

f "p'^p+l ] 

1 l r, J 

’ J P ( 

a -a 

^})*° 

and 




C 1 - c ? 17 J p -1 





and thus application of Lemma 2.5.2. gives 

A <m-l> < 0 , A (m) £ 0 A*<p-1> < 0, and A <p> £ 0, 
s s 1 
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Now on using the fact that A < i ) < A (i + 1), and A*(i> < A*(i+1>, 

s s t t 

we get 

A <i> < 0, 1 = 1 m-1, A <m> > 0, 

s s 

and 

A*(i> < 0. l = l,.. t p-l, A*(p> > 0, 

that is, m is the smallest integer such that A g (.) > 0, and p is 

* 

the smallest integer such that A^< . > > 0. 

Now result follow from Theorem 2.4.1. 


Values of -J^(c) are tabulated 
various values of t and c. 

^ CA i / ' 1 f k 
(Wn ^ t>v ~ ®'o ^ A 1 C> " ' 


in Goel and Rubin (1977) for 


, \ V 

\i_) 's*3V>Hy\l Q 0 ,V 


\ 

I V\t. 


is , in x \Al'ML (jd ^ ^ ''C* >aC< X> Q.\a^ 

fX-ne iwWV^A(^\ ^ VU 


CllArO W0^= WrMA 



CHAPTER - III 


Simultaneous Selection of Extreme Populations : 
Bayes-P* and Minimax Rules 


3. 1 I niroduc ti on 

To ensure high probability of CS, Gupta and Yang <1985) 
considered only those decision rules for which posterior 
probability of CS is at least equal to P*, a pre-assigned number, 
and then derived a Bayes rule among these rules for the goal of 

selecting a non-empty subset of Crij rr k l containing the UEP. 

For selecting a non-empty subset containing the UEP, Berger (1979) 


derived minimax rules 

i n 

the 

class 

of rules 

satisfying 

P*- 

condition (P 0 (CS) > 

P*. 

v e 

e O) 

when 

the loss 

i s 

measured 

by 

subset size. Gupta 

and 

Mi escke 

(1986) 

dealt with 

the 

problem 

of 


selecting the UEP among k normal populations (with possibly 

unequal variances). They establish that if the risk is measured by 

the probability of incorrect selection then the natural decision 

rule which selects the population corresponding to largest 

observation is min i max if and only if all the variances are equal. 

In this chapter we extend the results of Gupta and Yang 

(1985), Berger (1979) . and Gupta and Miescke (1986) to the problem 

of simultaneous selection of the LEP and the UEP . Section 3.2 

deals with the problem of finding Bayes— P rules (Bayes rules for 

* 

which posterior probability of CS is greater than or equal to P f 
where P* is a pre-ass i gned constant) with respect to a general 
class of loss functions. Problem of finding a minimax rule in the 
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class of rules satisfying P -condition is studied in Section 3.5. 
In Section 3.4, we investigate the minimaxity of the natural 
decision rule (which selects the populations corresponding to 
largest and smallest observations as the LEP and the UEP. 
respectively) for simultaneously selecting the lower and the upper 
extreme normal populations (with possibly unequal variances), when 
the risk is measured by the probability of incorrect selection. 

3. 2 Bayes — P* Rules 

In this section we continue to follow the set-up of 
Chapter II so that the observation X from n has a pdf f(.;0.) 

l l l 

and random variables Xj,...,X^ are statistically independent. 
Consider the goal of simultaneously selecting two non-empty 

subsets and of Cl k) containing the indexes of the LEP 

and the UEP, respectively, so that our action space is given by, 

sf = ((aj.a^) : aj c (1 k>, a^ c Cl k> , a^ * <p, a,> * ^3 

where tp denotes the empty set. 

Let t(©) be a symmetric prior distribution on the 

A* 

parameter space O and suppose that the posterior distribution of B 

given X = x is absolutely continuous in 6. For the problem at 

hand , the CS is an event which selects the index of the LEP in 
and simultaneously selects the index of the UEP in Sy. Let 3) 

denotes the class of all decision rules and suppose that for a 
given decision rule 6 € 2), P(CS|<$,x> denotes the posterior 

probability of CS given X = x using rule 6 e 3). For a specified 

constant P*. define 
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3> p <P*> = C6 e 5) : P ( CS 1 6 , x ) > P*. V X € X) 

that is, <5 « 2>p<P >. if and only if 
k k 

1 1 **, , < ^ > a p *' v ; * *• 
1=1 J=1 

1 * ) 

where 


w < x ) = 
M . J - 


i 


6< (aj ,a 2 > | x) 


(aj , a £ ) : iea 1 , ]«a 2 


are the pair selection probabilities associated with decision rule 
<5 and 

p,,<;> - p(e , * ®tn and ®i 1 ®tk:l? = 2’- 


Define 


D p(P*> = {<5 c 2> p (P*) : <5 is non-randomized} 


Since the posterior distribution function of 6 given X = x i 


absolutely continuous in 6, it is clear that 


i 1 = 1 • V ? 6X 

1=1 1=1 
1 * j 

and hence 2>p<P ) is non-empty. 

Remark: If y/ 6 ’s take on values 0 and 1 only, then 

1»] 


<5( (aj ,a 2 > j x> 



6 

if aj x a 2 = C < i . J > : V' i 
otherwise 


,<x> 


1 


n 


where Sj x a 2 denotes the Cartesian product of the sets a, and a*. 
Thus, a non-random. zed decision rule is unipuely determined by 

<5, 

pair selection probabilities V* j < j 8 • 
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<$ <$ 

For example if k = ?. y>j ^<x> = ^(x) = 1, and all other 

v? (x) ’ s are 0 , then 
r i • 1 ~ 

1. if <a lt a 2 > = <U,2>,C5}> 

«5< <aj ,a 2 > | x) = < 

0, otherwise 

Defini tion 3.2.1 

A loss function L is said to have property , if 
<i) L satisfies (2.2.2), 

< i i ) L<©. <aj ,a 2 >> = L(g0 . . 9«‘ 2 > > . 

for all e e n, (a, ,a 2 > e j4 , and g c G, 

(ill) L<e,<a. ,a 2 >> ^ L<0, (a' ,a' 2 >> , if a } c a'j and a £ c a' 2 

Our aim is to find a Bayes rule in the class D p (P ) under the 
above set-up. The following lemma is useful in doing so. 



Lemma 3 . 2 . 1 : Suppose that the pdfs fC.;^). i - 1 k f* ave MLR 

property and the prior distribution r W) is symmetric on Cl, then 


(i) p. . <x> > p., (x), for x., £ x 

1 ) iv * 3 ~ 

( i i > p . (x> > p. , <x> , for x > x , 

l ] m 1 J /v J 

Proof: 


( i > p j . (x> - P i# j <x) 

= m<x> J <E t j <0> 
O 


k 

E. ( .< 0 >> n f (X, ; e, >dr< 0 > 
1 1 ~ 1=1 


where 
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<©> = \ 
i ) ~ 1 


1 . 


if© = © and © = © 

i L 1 j j 


[k] 


L 0 , otherwise 

and m<x> is the normalizing constant. 


p (x> - p . , (x) 

i) ~ i 1 ~ 


= m< x ) 


| J <E <©> - E <©>> n f < x ;© >dT <©) 

L 1 J ~ 1 ) - „ n e e ^ 

{©:©.<© , } e_1 
„ l 1 


; 


C©:© =© , } 
~ 1 1 


C©:© >© , } 
~ 1 l 


(E <©) - E <©>> n f (x ;© )dr (©) 
1 J ~ i ) ~ e e 

e-l 


(E <©) - E , <©)> n f(x ;© )dr <©) 1 

i J ~ i ) ~ j e e „ J 


Now, since r is symmetric on fi, and the posterior distribution of 
© given X = x is continuous, the second integral is zero and roles 

*V /V A/ 

of ©. and ©., can be interchanged in the third integral so that 

p. (x> -p, <x) 

i ) ~ i J ~ 


= m< x ) 


C©:© . <© , > 
~ l l 


<E .<©> - E . , .<©)) n f<x :© > 
*> ~ 1 J ~ e *l e e 

e* l , l ' 


(f (X ( ,e. >f<x i# J© 1# >-f <Xj »e i# >f <x jf ;©J )) dr <©> 

Now using the MLR property of pdf, and noting that if ©. < ©., , 

then E <©> > E ,.<©>, we get 
i ) ~ i' J ~ 

P . (x> - P., <x> > 0. 

i ) ~ i ) ~ 

< i i ) Proof is similar to that <i> with obvious modifications. 
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Recall that CiJ denotes the index of population associated 

s t 

with X j- t -j and the decision rule 6 ’ <1 < s , t< k) is defined by 

r l . 


.s . t 


< (a^ .a^) J x> = ■{ 


Lo. 

* 

For a given P , x e X , let 

l k 

A^x) = <) ■ J I 

ij=i l 2 *k-j+i 


if aj = £tl } ts) } and 

a 2 = t Ck-t+1 J Ck>> 

otherwi se . 


p Uj)u 2 ) < i > * p >' 1 = 1 k 


and 


for A . < x ) * <P, let u<i) be the smallest integer in A^x). 


1 ~ 


Further suppose 5* = Cis 1 * l < k and A.<x)^J. Define 

D <p*) = { < 5 1,U<1> : ie^> 
o 


Mote* Since for any P* and x € X, A <x>* 4>. therefore D q <P*> is 

______ M T\ t 

non-empty . 

* 

In the following theorem, we prove that D q <P > is an 
essentially complete class for finding a Bayes rule in D p (P*> . 


Theorem 3. a. It Suppose that the assumptions of Lemna 5.2.1 are 

satisfied and the loss funct.on L has property T £ defined by 

0.2.1). Then D <P*> is essentially complete for finding a Bayes 
o 


* 

rule 1 n Dp < P ) . 

Proof t 

Let 

d£<P*> = € D b 

where D_, is the class of 
s, t = 1 k. 


P(CS |<5 , x> 2: P*> 

decision rules of the type 6 
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First we will show that it is enough to find a Bayes rule in 

Dp(P >- For this, let 6 be any decision rule in D p (P*> and 

suppose that <5 selects subset pair <{i i ), { j }) 

^ S 1 t 

w.p.l. Now consider the decision rule <$ s,t which selects subset 

pair <{{13 fs33 f {{k-t+l> fk33) w.p.l. Since £ € D p <P*>, 

we have 


P(CS |<5 , x> =2 J P ■ (x> > P* , V x € X 
i=l m=l 1 m ~ 

Now on repeatedly using <i> and (ii> of Lemma 5.2.1, we get 

s k 


P*< P<CS|«.x> < l l P tlJCmJ <;> • P<CS|6 S ’‘.X> 

1=1 m=k-t+l 

Hence 6 s ’ 1 € D p <P*>. 

Now, on using Lemma 2.2.2, we have 

r(T ,6 s ’ 1 ) = f r. <x , < { Cl } {s33, Uk-t + 13 Ck33>> dx 

“ j- /V 

X 

< f r. (x, ({i. i 3 , {), J . 3 > > dx 

J 1 1 s J t 

X 


= r <r ,6) . 

Hence D p <P*> is essentially complete for finding a Bayes rule in 
D p <P*>. 

<£» 

Now the result follows from the definition of D^(P > and 
(m) of (3.2-1). 


With the given cond 1 1 i ons on the loss f unct 1 on no further 
simplification of Bayes rules is possible. As an alternative 
consider the class of decision rules 
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1> P <P 1 ,P 2 > = € ® : P(n n> € S l |6,x> > P*. 

P(n (k) € S ul 6 ’^ > 5: P*. V x € X> 

* # 

where Pj and P^ are pre-assigned constants. Thus. <5 e .2>p(P*,P*>, 

if and only if 
k 

^V /< ^<x>P i <x)>P*, Vx<=X 
i =1 

and 

k 

y y 6 . ( x ) p < x > > P* , V x e X, 

J=1 

where 

= 2 «<<»j.aj>|x>. 

(a^ .a^) s lea j 

= 2 6( < a 1 .a 2 )|)<). 

(aj .a^) : jea 2 

p <x) = p<e » © r . . IX * x> . 

l . „ l L 1 J 1 ~ 

and 

p . j ( ^ * p<e , = = ; K 

Let 

D P <P 1 ,P 2 > = {<5 € a> P <P l* P 2 ) 5 6 is non_randomizecl> • 

Since the posterior distribution function of B given X = x is 

A/ A# 

absolutely continuous in 6 , it is clear that 

A/ 

k k 

J p } <x) = 1. and J P j<x> = 1 
i =1 ~ i=l 

and hence DptP^.P^) is non-empty. 
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Remark : For a fixed P*. there exist Pj*, P* such that D p <P*,P*> c: 
* * * 1 + P* 

Dp<P > <Pj ~ ^ Z ~ — Z — 18 one suc ^ possible choice). 

Now we will find a Bayes rule in the restricted class 
DpCPj.P^). To obtain a Bayes rule in Dp(P*,P*), we need the 
following lemma. 


Lemma 3. 2. 2* Suppose that the pdf’s f l = 1 k have MLR 

property and the prior distribution r(0) is symmetric on O. Then 


< 1 ) 

p <x) > 
l . ~ 

P i' . 

<x) . 

for x j# : 

<1 1 ) 

p < x ) 

• 1 ~ 

P .i' 

< x> , 

for x . > 
1 

Proof* 

Since 





k 

P <x>= \ p. .(x) and p . <x> 

1 . ~ La 1 J «v * i ~ 

1 = 1 

the results follow from Lemma 3.2.1. 


k 


Y P- • <x) 

L 1 1 ~ 


For given x € X, let m, p e U kl be such that 


m = min {i : ^ P r - - — p ’ ^ 


l l = 1 


'Uj). '2' ‘ 1 


P = min { ] 


l 


l 2 =k- j+1 




<3.2.2) 


In the following theorem, we prove that the decision rule <5 
Bayes in D p <P*,P*) where m and p are defined by <3. 2.2). 
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Theorem 3« 2. 2 : Suppose that the assumptions of Lemma 3.2.1 are 
sat i sf i ed and the loss function L has property 1 £ defined by 

(3.2.1). Let m.p € Cl k) be defined by (3.2.2). Then the 

decision rule 6 m,p is Bayes in D p (P*,P*>. 

Proof i Let 

D P <P 1 ,P 2 > = {6 € D b : P<7T (i) € S l |<5.x) > P*. and 


Pin 


(k) 


e S u |6 f x) > P*. V x «= Xl 


where D B is the class of decision rules of the type <5 S,t , s, t 
1 k . 


First we will show that it is enough to find a Bayes rule in 

D P <P 1 ,P 2 > ‘ Por thls * & be any decision rule in D p (p ** p *> and 

suppose that 6 selects subset pair (Ci i }, {j j 3 

1 s 1 t 

w.p.l. Now consider the decision rule 6 S ’ ^ which selects subset 

pe. lr (CCl},...,Cs}} t { Ck-t+1 ) tk}} > w.p.l. Since S 

Dp(P* t P 2 >, we have 

s 

7 P <x> > P* , V x €= X 

1=1 l 

and 

t 

7 p (x) > P* , V x e X 

1=1 

Now on repeatedly using (i) and (li) of Lemma 3.2.1, we get 

s s 

P I * I £ I p tn. ( ; > 

1=1 1=1 


and 


t k 

P 2 ~ 2 S 1 P .H>‘S > 

L =1 L i=k-t+l 
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Thus. 6 S,t e D p <P*.P*> 

Now. on using Lemma 2.2.2, we have 

r(T.6 s,t ) = J r 1 (x.(iin <s33. Uk-t+13 (k33)> dx 

X 

~ X r i ( ^* ({i i » s 3, . .. ,3_^3>> dx 

X 

= r(T ,<$> . 

^ 

Hence D p <P lf P 2 > is essentially complete for finding a Bayes rule 
in D p ( P* . P* > • 

Now. since among all rules in D p (P*,P*>, 6 m,p selects the 
smallest sized and S^j, <5 m,p is Bayes in D p (Pj,P*>. 

Let E < | S L | | Sjj j <5,x> denotes the posterior expectation of 

product of sizes of subsets selected by 6 € D p <Pj,P 2 >. For any 

-ft * 

decision rule <5 e D p (Pj.P 2 >. the posterior efficiency of 6, given 
observation X = x, is defined by 

P(CS 1 6 , x > 

= E< | S L | |S ut '177x7 • 

The expectation of ef f <6 j X > is the efficiency of the decision rule 

& * 

<5 and is denoted by eff(6). A decision rule <5 € 1 5 

called most efficient in Dfc>< P l ,P 2 > if eff<<5> > eff (6' ) for all S’ 

€ V 3 *’^ • 

The following theorem shows that decision rule 6 p is most 
efficient in D p (P*,P*) . 

Theorem 3. 2. 3t Suppose that assumptions of Theorem 3.2.2 hold, 

# * 

then the decision rule <5 m,P is most efficient in D p (P 1 .P 2 >- 



89 


Proof* Since, among all decision rules in D p (P*,P*>, given any 


observation X - x. 6 has minimum sizes of the selected subsets 

S L and S U ' any other decision rule 6' in D p <P* t P*> should have 
its sizes of S L and S (J equal to m+Cj and p+c 2 . respectively, 
c j , c^ ^ 0 , Now 


m+c. 


(m+c j > < p+c 2 > ef f <<5' |x) = Y 


k 

2 


l l =1 l 2 =k ~ p-c 2 +1 
m k-p 

■ [2 2 

lj=l l 2 =k-p-c 2 +l 


p ci 1 > a 2 ) < i > 




m 


► 2 2 

Ij=] l 2 =k-p+l 

m+c. 

1 k-p 

h 2 2 

l^m+l i 2 =k-p-c 2 +l 


P a 1 }u 2 ) < ^ > 


p a 1 ja 2 } < ^ > 


m+c. 


+ 2 2 P U 3CI ? > < ~ > ] 

i j =m+l l 2 = k-p+l 
m 

“ [ C 2 2 P U.Hk-p} < * > 

l * 5 _ *1 * 


l l =1 


m 


k 

2 2 


l 1 =1 l £ =k-p+l 


P {l 1 }Cl 2 } < ^ > 


(x) 


+ c l c 2 P Cm+l>Ck-p} ( ^ 
k 

+ C 1 2 P Cm+l}{t 2 ) < ^ > ] 

l 2 =k-p+l L 


(using Lemma 3.2.1) 
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C 1 C 2 C 1 
4 1 4 — - — - 4 J 1 
mp m 


) 


m k 


1 1 p a 1 }«-> < 2 > ] 

lj=l i 2 =k- P 4i 1 2 


(m4Cj ) (p4c 2 > 
" rnp 


m k 

1 1 

ij=l l z =k- P 4l 




= (m 4 c j > (p 4 c 2 > eff <<5 m,p |x> 


Thus , 


eff <6' | x > < ef f (6 m,p | x) V x € X, 


and therefore 


eff <6' ) = E < ef f (S' | X) ) < E(ef f <<5 m ’ p | X) > = eff(<5 m,p > 

/v 


; m.p, 


3. 3 Mini max Rules t Specific Loss Function 

Xw jtUa ^>'nfsre. dk*, ^wu-ciiKL Hr 

1>vaJLe,wCc^ oki MvoUr^- Ciq g?; to uAtt^ ir */ A , 


Suppose random vector X = (Xj X^) has 

joint 

dens i ty 

9 y (x,0) and we are interested in selecting a subset 
A 

A/ 

pai r 

<S L ,S U > 

such that S L contains the LEP and Sy contains the 

UEP. 

Cons i der 

the loss function given by 



L(©.<a 1 .a 2 >) = |aj| |a £ | - \a } n a £ | 


<3.5.1) 


For a given P* ^XFTjy * P* < 1 j • define 

3)( P*> = <6 e S> : P fl (CS|<5) > P*. V 0 e 

^ A* 


where as before, CS denotes the event g Sy and n^j e Sy}. 
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Suppose that 


°i j = { t € ° ! ®i = e [13 and e , = e tk] 3 . ».J = !.••• 
If a parameter B point could be placed in more than one Cl 

the point is arbitrarily put in one of the sets. This is 
ensure that CQ^} forms a partition of Q. Suppose 
Q = CB e Cl: B e O for al 1 l . )} 

where Q denotes the closure of the set Cl . For 6 € 3), 
i ] l ] 


,k, 


i J ’ 
done 


then 

to 


1 et 


R(£?,6> = ^ L(0, <aj .a^) > <5( (a^ .a^) | X>J 

~ <a 1 ,a 2 >€j 4 

denote the risk associated with the decision rule 6. We desire to 
find a rule <5 , which is minimax in 2XP >, i.e. a rule <5 which 
sat l sf l es 


sup R(©,<$*> = inf SU P 
Cl ~ 6e3)(P ) Cl 

To find such a 6*, we will first find the minimax value of the 
problem. Following theorem gives the minimax value of the 
problem. 


Theorem 3. 3, 1 : Suppose is non-empty and P& (Select n ^ in 

A/ 

and n ^ in Sy|<5> is continuous at B^ e for all 6 e 3) and for 

all i * ). Then the minimax value with respect to the loss 

* 

function given by (3.3.1) is k(k-l)P . 

Proof : Recall that 

. ( x > = J 6( (aj .a^) | x) 

(a j , a^ ) : i«a j , j«a 2 


Then 
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R<e,6> = E 


©[ 5! < l a ll I a 2 1 " | a j n a 2 I } <5( <a j >a 2 * I X> 1 

<a^ .a^ ~ J 


= E, 


[ 2 2 
<a 1 ,a z >€^ <i.j):i€a r 


6((aj .a 2 |X) 


jea. 


1 I 6(< ai .a 2 >|X)J 


^ a l 1 : 1€a j na 2 

k k 


■[2 2 2 


i-l j = l (a^ .a^) : lca^ , jea 2 


6< (a } ,a 2 > |X> 


k 

2 

i = l Caj ,a 2 > : 
k k k 


2 


6( (a 


j.a 2 )|X>] 


= E e [2 2 <,<?> - 2 <,'?>] 

~ i=l i=l i = l 


Therefore , 


i=l j=l 

k k 


R (e.«) = E e [ 2 2 


( 3 . 3 . 2 ) 


1=1 j=l 

Consider the no-data rule 6^ , defined by 

r * 

1 -P 

) — 1 1 a^ — Cl). a 2 ~t j 3 , i , j -1 , . . . k.i^j 

<S l <<a l ,a 2 > l^ > = "j k(k-l )-l ’ a l =a 2 =C1 k> * V * € X 


, otherwise. 


Clearly <5j is a valid decision rule and 


^ < x > = P , V x e X, i,j - 1 
l.l ~ 


. ,k. l * j 


Therefore , 


R<e,«5, ) = k(k-l >P , V B c O 

0%f i ~ 



93 


and the minimax value 


6e3KP 


inf * sup R<©,6> < sup R(e,6.) = k(k-l)P*. 
0<P ) 6 q ~ 1 


i ] * n ~ ^>2.... 3 be a sequence in 0.^ which converges 
to e ^ j j guarantees the existence of such a sequence). 

Since Q i ^ e j « selection of in and n . in Sy is a correct 
selection at ©" . Suppose <5 <= £>(P*) , then using the continuity of 
P^CSelect 7i ^ in S L and tt j in S (J |6> at © E . we have for all i * j . 

(yf .(X>> = P_ (Select n in S. and n in S..I6) 

1,3 ~ 1 L j U 1 


£im P (Select n in S. and n in S,. 6) 
- n i L j U 


n->oo & 

~ i ) 


= -fim P (CS 1 6 ) > P 

n-*oo & 

~i ) 


(3.3.3) 


This is true for all 6 e 2>(P ) and for all l ^ j. Hence for 
any 6 e 5>(P*) 


sup R (0.6) > R(© <5) 

Q 


k k 


■ e ?e (2 5 *,«>) 


i=i )=i 
i*j 


> k(k-l)P 


(from (3.3.3)) 


which implies that minimax value is not less than k( k-1 ) P and the 
result fol lows . 


Following theorem due to Berger (1977) provides conditions 
under which the continuity assumption of Theorem 3.3.1 is 


sat i sf i ed . 
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Theorem 3. 3. 2 = (Berger) . Suppose Cg(x ;©>,© € n> are densit ieS 

A ~ ~ ~ 

with respect to a measure p which satisfy 

< l > as © ► © c , g v (x;©> — t g (x'B ) a e ti 

or (ii) as © ► © £ , g x <x;©> — ► g x <xj© E > in p measure. 

Then for any bounded measurable function y/<x>, E £s <v'<X)> is 

continuous at © E< 


Example 3,3, 1* Suppose © is a location (scale) parameter and 
g x ( x ; & ) = 9 <x ~0 ) |g x ( x ) = g — . . . g — g Jg — • g — . . . • # g— J j is the 

6. |( 

pdf of X with respect to Lebsgue measure, p, on 0? (<0,a>)x ... 

(V 

x(0,oo)). Suppose g(x) is continuous a.e. p. Let A be the set of 

k 

discontinuities of g. Then for fixed 9- e R (<0,oo>x ••• x(0,co>), 

the set of x for which g(x-©)|g— g— g£g- ©~)} 1 8 n °t 

continuous at ©_ is (x:x = z + © F , z e A1 = A + © F <Cx:x. = z.© , 

i = 1 k , z e A> = A.©p) and p(A) = 0 implies that p<A + © E > = 

p( A) = 0 (p(A.©p> = p< A) = 0). So condition <i> of Theorem 5.3.2 

/v EL 

is satisfied for every 0- € DR^ ( ( 0 ,oo) x ... x ( 0 ,oo)J and Pg (Select 

iv El 

k 

n in S, and n. in S. , I <5 > is a continuous function of © on R 
1 L j U 1 ~ 


C(0,oo)x ... x(0,co)) for any 6. 
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Example 3. 3. 2t Suppose X has a multinomial distribution with cell 

probabilities 6 = <©^ © k >. The sample space is X = 

k 

{<x 2 x k> : * i € C0,1,...,N}, ^ X i = and the parameter 


space is O = C© : ©. > 0. l = 1 k and ^ ©. = 1). The density 

i = l 

with respect to counting measure on X is given by 


[N_ 


g (x;©> = -r— r— o 

A a/ #w | • • » X 


*1 x k 

e ' ... © k k . 


x e X. 


For every x e X this is a polynomial in 6 so is continuous in ©. 
So again, condition <i> of Theorem 3.5.2 is satisfied. 


Now suppose that Xj X^ are k(> 2) independent r.v.’s and 

suppose that the observation X. from rr has a pdf f v <x ;© ) = 

1 1 A 1 1 

f ( x -e ) , i = 1 k. Mishra and Dudewicz (1987) propose 

l l 

following decision ru ie R MD‘ 

R md : Select tt i in S L if and only if Xj < X [13 + dj 

and 

Select n ^ in S^ if and only if Xj t X^ k ^ “ dj 
where dj is chosen such that 

co s+dj k-2 

inf P 0 <CS|R md > = J J ^F<s+d 1 >-F(t-d 1 >J f(s> f<t> dt ds 

° -CO -00 

Here F denotes the distribution function corresponding to f. 
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Lenroa 3 - 3 - 1 ' If f X i <x i ! ®, > * i = 1 k and pdf, 

f X have MLR Property , then eupreroum of R<e,R > , 6 

1 ~ MD 

attained when 9^ = ... = © k and sup R < e . R MD > = k(k-l)P*. 


ft 


k k 

Proof* r <®- r md > = J J Pg <Se 1 ect in S L and n in SjR^) 

i= 1 j=l ~ 

k k 

= l l P e <select n (j) in S L and « in S^R^) 
1=1 )=1 ~ 
i*J 


k k 


2 2 P 9 { X (i> “ X C13 d l • x < j ) ~ x [k]" d l ) 

i=l j=l ~ 


k k oo s+e [ jl _0 C i3 +d l 


2 2 / / 

i = 1 ] = 1 -oo -oo 

i*J 


n < F ( s +0 r . _ -0 r , _ + d . > 
l = j C j 3 ti] 1 

l*i , ) 


- F(t+0 r n - 0 r , - - d,)> f < s ) f(t) dt ds 
C l 3 Cl 3 1 


<3.5.4) 


For k > m > 1, and for fixed 0j- m+ j ] • •••• ®[k3’ 


V e> - E e 


[ 2 L< ?' la J ,a 2 >> 4 <<a l ■ ' =e tm 3 =e,R MD) 


~ < a 1 , a 2 > e ^ 


s+d, 

m m oo 1 )< 

= 22/1 l " ] 
1 = 1 j =1 -oo -oo 
1 * j 


<F<s+0-0 [;i;] +d 1 )-F(t+0-0 [i;] -d I )> 


l*i . J 


f<s> f(t) dt ds 
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m k to S+e [,]" e + d ] 

+ 2 1 x j 

1 = 1 j = m+l -oo -cd 


^ < F <.*> cn - e m+dl > 

i^l . j 


F<t+9-©^ ^-dj > )f <s)f <t)dt ds 


k m cd s+0 " e Ci3 +d l 


* 1 Is s 

i=m+l j = 1 -oo 


-oo 


n (F<s+0-0 +d.) 

1=1 LtJ 1 
l* i . j 


- F< t+0£ . ^-0^ ^j-dj >)f<B>f(t)dt ds 


k k oo S+e cn _e [il +d l 

l l I i 

i=m+l j =m+l -oo -oo 


FI (F(s+0 r . _ -0 _ , _ +d. > 
j.j C j 3 C 13 1 

1*1 . J 


s+d, 
oo 1 


F<t+© [ . ; j-0j.j^-dj)>f<s>f<t)dt ds 


. m-2 


m(m-l) J J (FCs+djl-FU-dj)) “ n (F< S+0-0J. l ) 


-oo -oo 


l = m+l 


- F(t+0-e [n -d ;i >) f (s)f (t)dt ds 


. s+0 r . , -0+d, 

k oo C j ] 1 

+ m J J f (F<s+0 [ ^-0+dj) - FCt-dj)) 

j=m+l -oo -oo 


m-1 


n <F(s+0 r .,-e r , +d. >- F(t+0-0 r , ,-d. ))f <s>f <t)dt ds 
l =m+l UJ L J 1 L 

l* j 


k . S + 9 " e ti J +d J 

** 2 / i 

i = m+l -cd — co 


(Fts+d^ - F(t+0 [i] -e-d 1 )> 


m -1 
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n (FCs+e-ej.^+dj) - F<t+© [j] -0 [i;] -d 1 ))f<s)f(t)dt ds 


l =m+l 1 

l*i 

. s+e r ,.-e r +d, 

k 00 C j ] [ i 3 1 


I / 


i =m+l j=m+l -oo -oo 

i*) 


(F(s+© [ J -,-e+dj > - F<t+© Ci:| -©-d 1 )> m 


t." + i <F< 6 te nr e m td i ) - F<t+e t.r®[ir d i >>f<B>f<t>dt ds 

l*i.] 

We now show that Q^©) is a non-decreasing function of © which 
proves that Q..<©> is maximum where 6 = 6 r , , and since this holds 
for any m < k. the first assertion of the theorem will follow. 
To show that Qj<©> is a non-decreasing we differentiate Qj<©> with 
respect to © and show that the result is positive for 6 < 


w V e> 


m(m-l ) 


s+d. 
oo 1 


J J (T<s+dj )-F(t-dj )) m 2 Y n CF<«+d-© [l] +d 1 > 


-00 “00 


i =m + 1 l-m +1 
l* i 


-Ftt+e-S^^-dj)) Cf(s+e-© [i;j +d 1 )-f<t+©-© ( . i:i -d 1 )) f<s)f(t>dt ds 


. S+0 r i ~&r ■ -i + d, 

k oo [ j 3 C i 3 1 


l 2 J J CF<s+e t ) r e+d i > ' F(t «tir e ‘ d i >) 


l =m+l j =m+l -oo -oo 
i* J 


n CF<s+0 [j3 -e m +d i > ' F<t+e Ci3" 0 Ci3' d l >) 
l =m+l 
i*i . ] 

c-f (s+e. -,-0+dj )-f(t+e [i;| -e-d 1 )) f<s>f<t>dt ds 
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+ m(m 


+ m 

J 


- m 

) 


+ m(m 


1 > 


k » s+e [,r etd i 

I f I 

j =m+ 1 -co -co 


(F(s+© [ J 1 ~e+d 1 ) 


F(t-dj)) 1 


m-2 


iZi <F “ 4 *io-m +d i > 

l* J 


F<t+e-e [i;] -d 1 >> 


(-f (S+0J. } -j-0+dj >) f <s)f <t)dt ds 
s+0 r --0+d, 


k oo “ — C j 3 1 

: m+ 1 -co -oo 


J J J CF(s+e u] -©+d 1 ) - F(t-dj )) 


m-1 


i 


i =m+l 
i*j 


l=m+l CF<S+0c n e [l] +d l ) F<t+e e [l]' d l )) 
1*1 . J 


(-f (t+e-e c . 3 ‘dj)) f (s> f <t)dt ds 


k oo 

]> J CF<s+e r .-,-0+d, ) - F(s+0 r ..,-£?)) 
: m+l -oo 


m -1 


Cl] W 1 ' ’ Cj] 


n C f<s« -Sjjj+dj) - f<«« -e tl] » 
i =m+l 
i*l 

X f(s)f<s+e [; ^-e+dj) ds 
i S +0 " 0 r -i + d, 

k oo C i ] 1 

1) l J J (FCs+dj) - F<t+e ci] -0-d 1 » 

i =m+l -oo -oo 


m-2 


n (Fts+e-e^j+dj) - F<t+e [ 1 ]“ e cn' d i >) 

1 =m+l 
i 

(f<t+© [i;i -©-d 1 )) f <s>f (t)dt ds 
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+ m 

i 


= [™ 



f<t+© 


• s+©-0 + d, 

k oo C i D 1 

l J S 

=m+l -oo -oo 


CFCs+dj) - F(t+© [ 


m-1 


2 , " +1 < F ‘—-*c» +d i> - F ‘ t «t.3-*tir d i» 


j =m+ 1 


l =m+l 
1*1 . ) 


f (s+e-ej. j^+dj) f(s)f(t)dt ds 


m 


k oo 

l S (F ( s+dj ) 

i =m+l -oo 


F(s>) n CF(s+©-© r . ,+d. > 
l =m+l LtJ 1 

1* l 


k oo 


- F<s+©-e m >) fts+e-©!-. j+dj) f <s)ds 


.m-1 


J J CFCs+dj) - F<s» n ' * n CFts+e-G^^dj) 


i=m+l -oo 


i =m+l 
l* 1 


F(s+e-e [l] )Xf(s+e-e ti] +d 1 )f(s))-f(s+e-e [j] ) fts+dj)) dsj 


i i s+d. 

k k oo 1 


l l J J < F<S+ V - F<t -V> 


m-1 


i =m+l j =m+l -oo -oo 
i*) 


n cFts+e-e^j+dj) - F(t+0-e [l 3 -dj>> 

l =m+l *■ 

l* i . j 

x <<f <t-dj >-f (s+dj)) <f<s-e c j3 +e>f<t-e [i3 +©>> - 
“ e [ j 3 -11 ! >f <t>f <s_e i; j] +e) + f<s+0 " e C )] +d l >f <S>f<t ” e Ci] + ~ >, ' dt ds ] 
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k 00 s+d l 


|m(m-l > J J J CFCs+dj) 


i =m+l -oo “oo 


F(t-d 1 )) m “ 2 


k 

n (F<s+©-© +d > - F<t+e-e r . -d,)) 

i=m+l Ltj i ill 1 

1 


(f <B+©-e ti 3 +d 1 >f <s)f<t) - f (t+e-©!. .^dj > f<s>f(t) 

-f < s+dj ) f <s-© c . 3 +©>f <t> + f(t-d 1 >f(t-© [i] +©> f(s>) dt dsj 
Now on using MLR property we see that all the three terms are 
non-negative and thus, 

a? Q i (e > * ! < Vr 


which proves the first assertion of the theorem. Second assertion 


follows by substituting = ••• = ®[j<] * n 0.3.4). 


As a consequence of above lemma, we have 


Theorem 3.3.3: Suppose that loss function L is given by <3.3.1) 

and pdf's f v (x ;© ) = f<x.-0 ), i = 1 k have MLR property, 

X l l ii 

l 

then the decision rule is minimax in 3>(P ). 

Proof : Clearly R MQ e 5>(P*). 

Also, 

sup r<©,r md > = k<k-l)P*. 

o 

the minimax value. Hence R^p is minimax in D<P ). 

Now suppose Xj X k are independent and X i has a pdf 

f fv .« i - 1 ff!-L) x > 0. ©• > 0. Consider the decision rule 

V 1 1 - ©; f leJ' x i 



102 


R defined by : 
M 


R^l : Select n j in if and only if x < 


'[1] 


and 


Select tt ^ in if and only if x. > d £ 


Ck] 


where d^ e (0,1) is chosen so that 


inf P e CCS|R M ) = P 


O 


M' 


(3.3.5) 


Lemma 3.3.2* Suppose f v (x^© ) = i— f 

- A i 1 l j i 


x > 0, © > 0. 

l l 


i = 1 k and suppose pdf's f v ( . ;© ) , i = 1 k have MLR 

A 1 

1 

property. Then for the loss function given by (3.3.1), 

(I) Infimum of P 0 (CS|R m ) is attained when ©j = ... = © k » 

( II ) Supremum of R(©,R M ) is attained when ©j = ... = © k » and 


(iii) sup R(© , R^,) » k(k-l)P 
O ~ M 

Proof* 


Cl] 


(i> e e <cs|R M > = P e <x u) -frf- , x (k> a d 2 x tkJ > 


Ck] s 


00 e Cl ] d 2 

= J J 

0 0 




f(s)f(t) dt ds 


oo d 2 

* / J ( F [fr) - F N) k 2 f<s>m> 


dt ds 


0 0 


and bound is attained when 


= © [k] . Hence 


P e (CS|R M ) attains its infimum at ©j = 


. . = © k and 
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s 



inf P e <CS|R M ) = ; J (V(l-) - F(td 2 )] l ‘ 2 f<s)f<t) dt ds 
^ 0 0 ^ 

Proof of (ii) and <iii) is similar to that of Lemma >.3.1. 

■ 

Following theorem is an immediate consequence of Lemma 5.5.2. 

Theorem 3. 3. Under the assumptions of Lemma 3.3.2, the decision 

•it 

rule is mini max in D(P >. 

The following Theorem 3.3.5, provides a set of necessary 
conditions for minimaxity of a rule in 5>(P ) with respect to the 
loss function given by (3.3.1). 

Theorem 3. 3. 5* Suppose that loss function is given by (3.3.1) and 
let 6* be a minimax decision rule in f>(P*). Suppose P^(Select rr j 

in S^ and tt ^ in Sy|<5*) is continuous at e for all l * j. 
Then for all © E e 

(i) R(© crt 6*) = k(k-l)P* = sup R(©,<5*) 

~ E O 

( l i > P ^ (Select n. in S, and n. in S.j|6 ) = P = inf P e (CS|6 ), 

i u ' O 

«v L. 

V i * j 

Proof* Fix 6 r e fl r . As in proof of Theorem 3.3.1. it follows 

fv L. El 



that 


in S L and n. in S u | <5*> > P . V l * j 


(3.3.6) 
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<i> Since the decision rule 6 is minimax in 3>(P >, it 


f ol lows 


that 

k<k-l >P* = sup R(©,6*> 
O 

> R(© e ,<$*> 
k k 


■ 2 2 

i=l j=l 


e. 


(Sel ect 


rr 


l n S, and n 


J 


in 




> k (k-1 >P* (from (3.3.6>) 

So all inequalities are equalities. Hence <i> is true. 

(n) From (3.3.6), we have 

P (Select rr in S. and rr in S..|<S*> ^ P , V i * j . 

o r 1 L J U 


Now suppose, 

P (Select rr. in S. and rr in S.J^*) > P*. for some i * i • 

& 1 L j 

<v u 

Then 

sup R(©.<5*> = R(6 > e ,< 5*> ( from (i>> 

Q 

k k 

= 2 2 p e <Select n i in s l and n j in s ul 6#) 

i =1 j=l ~ E 
j 

> k(k-l)P* 

which is a contradiction. Hence, the result follows. 


3.4 Mini max Rules Under Heterosc edasticity 

Suppose that the observation from rr. has a normal 

2 

distribution with mean 9. and known variance o'., i = 1 k. (k > 

,, . y y are statistically independent. In 

3), and suppose that Xj are 3 
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the case when our goal is to select two extreme populations 
associated with and our action apace is given by 

*f* = {(i,j) : 1 « U k> , j € {1 k)> 

where taking action <i,j) corresponds to the selection of n as 

l 

LEP and the selection of n ^ as UEP. 

For convenience, we assume that there are no ties among 9^'s. 

N E 

We call the decision rule 6 ' , which selects the population 
associated with as the LEP and the population associated 

with as the UEP, as the natural decision rule. For given 

decision rule 6 € 3), and x e X, let 6(<i,j>|x> denote the 

conditional probability of taking action <i,j> given X = x. 

Suppose that the risk associated with a decision rule 6 is 
given by : 

R(0,<5> = l-Pg(CS|<5) (3.4.1) 

To find a mini max decision rule, we first find the minimax 
value of the problem. The following theorem gives the minimax 
value of the problem. 




106 


Since the no-data rule 6 has constant risk 1 


. i t 


suffices to find a sequence of prior distributions for © = 

<©2 such that the sequence of associated Bayes risks 

tends to this value 1 - (See Berger (1985), p. 354). For 

this, let 


‘ <0 1 .... ,0. ) = n^ n 4>(Yn 9 ) d© , 
n 1 K i=l 1 


n = 1.2. . 


be a sequence of prior distributions for 9 - (6 9 ) 

A/ i K 


Then , 


given X = x, ©^ © k are independently distributed with 9 . 


having a normal distribution with mean 


i 


and variance 


i B 

— ^ — , i = 1 k. Thus, the Bayes rule 6 , say, which 

no- +1 

l 

minimizes the posterior expected loss, yields the posterior risk 


R (<5 B I x) = 
n 1 „ 


i . j=l . 


”- p<e i = ®cn *" de , * 


Def i ne , 


= 1 - max 

i , j =1 k 

i* j 


P<0 1 = 0 [1] a " d 0 j 




9 1 

1 <n<y£+l) 

2 I 




. I = 1 ..... k . 


Then 


R (o x> =^(1 
n ^ 


- p (©i = 9 U1 and 9 ) = e [k;1 1 X s *> > 
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= 1 - max PI 

i . )=1 k ^ 1 lrwv 2 J.l J — 2- 

i*) 




2 1 


< Z. 


no\+l J n<y j + 1 1 


t£r) 


I 

+ -4— < 

w i +i 


i 




2 * ^ ~ 1 k, 1 ^ i < ) t find 

ncr +1 
J 


2 

r- ■ 

1 

2 X 

2 

r 0 - 

1 

.2 

X . - 

1 + 1 < 7 

r j 


J 1 

w 2 +i- 

1 

’ n<y 2 + l j 

2 

W:+i j 

1 + 

ner 2 +l-' 

J 


Let 


2 I 

-na +1- 2 


f nv . i j. t f f u 

tH K J 77 ] 


X . 
] 


2 2 
no'j+l no’T'+l 


2 + J 


so that 


B, 


R ( 6 0 x> 
n 


= 1 - 


max 

1 a ) = 1 a 

i*j 


S i nee 


. .k 


u ( s ) 

00 n, 1 . j 

X X 


-00 -CD 


n ( 5 (u , ,<s)> 

1=1 n ' l ' J 
1* i . j 


5 (u , . (t) > x 

n , 1 , 1 


^<t>^<s> dt ds 


Therefore , 


iimu. (s) - s 
n, 1 , j 

n-K» 


■ B, 


l im R <<5 x) 
n 


n-*» 


00 s 

= 1 - J J (S(s) - §<t >) k " 2 *<s> ^<t> dt ds 
-00 “00 


1 " k(k-rr • 
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For the prior t ^ <n = 1,2,...), let r(r^ ,6) denotes the Bayes risk 
associated with the decision rule 6. Then after repeated 
application of Lebesgue dominated convergence theorem, we get 


Lim r(x ,6®) = 1 - — rT 

n k(k-l) 

n->oo 


This completes the proof of the theorem. 


The following lemma will be needed in examining the 

N E 

minimaxity of the natural decision rule 6 ' . 


Lemma 3. A. 1 * Let J'j • • • • •J'k-i be k_1 positive constants. The the 
function 

co **: 

h( i'i x 

-oo -oo 

is strictly decreasing in r 1 and strictly increasing iny., 
j = 2 k-1 . 

Proof* Consider the partial derivative of h with respect to 
keeping all other t'j’s fixed 

xj'i 

%- - X X % [Xxj" j) - *o£>] (* - y - «y 

2 -00 -oo 3 


k-1 

n [i 

J=2 l 


r, 

5 <xy j > - §(y — 


k] <P { y'> 

l J 


<p(x) dy dx 


4>{ y> <p(.x> dy dx 


xr, 

oo 1 

- X X 
“00 “00 

00 1 
-X X ^ 

-00 -oo 
■ c i - °i 


X V fscxj-p - *Cv p-)l *<y> *<*> dy d * 

j = 3 1 J 1 

V [scxjXjj - «y «y *<y> *'*> dy dx 

say. 


<3.4.3) 
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where . 


C 1 = 


xr, 

oo * i 


! k-1 r 

-T J x n ~ 5(y p~^J 4K.x Vl+y ^<y> dy dx 

n -a> -oo * 


and 


XT' i 

oo '1 


D, 


-oo -oo 


= h ^ {_ [_ y *( y | 1 + pf ] (“•O', > - * <y pf]) 


^<y) ^>(x> dy dx 


Now 


xy , 

oo 1 


C, = 


w j< _ i y 

— — f f x n \$Cxr ,) - Hv rr-)] •Kx-Zl 4><y> dy dx 
-/2rr J J j=? t ) ^1 •> 2 


-oo -oo 


®> , ® k _J y 

= — r J f x <Kx Vi^b n fscxr ,) - *Cy r 1 )] 

-/ZiF I J z j = 3 1 ] r l J 

— rm V, w 


^>(y) dy 


-oo'- y 

r 


1 


On integrating the inside integral by parts, we get 


C, = 


00 r tp( xi/l +r ?) k-l ^ ill 

-i_ r [ j— — n fsCxj'O - *Cv p->J 

ysr J l 1 +r) i=5 l 1 r i JJ i_ 

—oo v 


^(y) dy 


<Vr+r^ 


® ® i, _ l y . . « -a r i * f 

+ ±: / 1 fc [,?, Hi 5 ‘ * Cy F 7 } )] 

-oo y 


£(y> dx dy 
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oo oo k- 1 


J 2 n (•<>«' ,> - *0 k>) r, *<*!-> 

-oo y i = 5 ’ ' 1 


FT - 


f x/l+^ 

g— j <fi<x) dx dy 


> 0. 


0.4.4) 


x^. 
oo ,1 


f k 1 

h ^r-I < S v <Ky Vf+rf) n f$C xjO - *Cv ^>1 dy} *<x: 

*" 1 -oo t -« i-5 1 3 r l j J 


On integrating the inside integral by parts, we get 


) = i_ _i_ j r 

1 r i ysr J l 


4> y l + 


ry k-i y n1 "i 

— n |S(xj' ) - §(y - 1 ) 

j = 5 1 J r l J J-oo 


1 + 1| 

y l 


#(x) dx 


» xj'j ^IT + r 2 

, 1 1 r r _ 

r i ^ ^ r\ 

"*00 —00 14 . ^ 

1 T 

y i 


L J k — 1 y 

1 (sCxj'j) - *(y py)J ^<x> dydx 


oo ^1 k -1 


r [J n f*(xr > - *C/ rr 1 )] p 

» So 1 ’ ri)ri 


r . % J'j r, 
_L) — L <p{y -j 

*vJ r, J' 


y l + ^2 


^(y 1 + j *<x> dy dx, 


(5.4.5) 



Ill 


On combining 0.4.3) - (3.4.3), we get 


Since h is symmetric function of y , . . . ,y 
3h 

9f- > °* for j * 2 k-1 

and hence, h is strictly increasing function of ? ' ,r k-l ' 

Now consider the partial derivative of h with respect to y^ , 

00 k _i 

= J x n ($ (.xy ^ ) - $ (.xy j > ) 4>(.xy^) <p(x) dx 
* -oo J ~ Z 

" k_1 k-i r r r- 

+ f f y n f*Cxy,) - 4Cy rr-)l y —4 <Kv — ^) ^<y>^(x> dy dx 

-oo -» ,r 2 i ; 2 1 ’ J A 1 


k-i » 


K-i 00 f ** ^ k-l y . 1 

= ^ JL y r M J y *<v i+ - 4 > n kxy,) - *Cy ^oldyU 

A ^ hz ' •* A ;:f l 1 rii J 

On integrating the inside integral by parts we get 


<x)dx 


k-1 oo 


4> V 1 + 


£h_ = 1 _ _J_ \ Y r f- 

^1 y Z YZn ^ 1 ^ L 

1 r l yc i =2 -oo 


ry k-l r y 

— n U(xr ,) - Ky rrO ^(x)dx 

j.ol ) Y j JJ.jjj, 


Y ; mX^ 
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k-1 to 

™ l L L* K( scx ^ - * cy Wn 


J*i 


<Ky 


1+ -J ) *(x> dy dx 
^1 


< 0 

and the result follows. 

■ 

Now we prove the main result of this section. 

Theorem 3. 4. 2s The natural decision rule <5^’ E is minimax if and 


only if a 


1 


2 

= <V 


Proofs Let denotes the variance of the population associated 

with © r and let 
[ 1 1 


v <x> = 

i . J 


xo , . +© r . n - 6. . n 

< ] ) C ] 3 C l 3 

o (. 1 ) 


i v j — 1 k . 


Then 


R(©,6 N,E ) = 1 - P e <X (]) = X m and = X rul ) 


'<k> C k 3 


v, ,(x) 
oo 1 , k 


- » - J X 


-oo -oo 


n <$<v. . <x)>-5<v. ,<y)> <£<y> ^<x)dy dx 
j =2 ),k 1,1 


Thus , 


N E 

sup R<©,6 ’ > 
Q 


v, ,.<x) 


oo '1 ,k 


k-1 


* 1 - inf J J n <*< v j k <x>-*<v jtl <x>» 4>< y> ^<x)dy dx 


a 


-oo -oo 


j=2 
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xcr 


(k) 


oo ^(l) . , 

^ ^ ^/i/ ) & r 1 \ 

= 1 - r f n (*<x - *(y — — — )} 4 >{. y)<*>(x) dy dx 

m 1=2 j) 

-00 “CD 


xa 


C 2 3 


> 1 - 


* " C13 k-1 

j J n ({(x 

-00 ~oo 
X& 


t2 -L. ) - *(y — - - — )) <£(y)£(x) dy dx 


j =2 ^cj+n ’ ^u+n 


C23 


oo a ill 


k-1 


= 1 


^3. } _* (y !m^ i± n )) 

& «• ts -i / & r 


- r r n c*(x — L±J - ; 

J J _ j =2 ^cj+n t, c23 , ‘'cn 

^(y)d(x) dy dx (3.4.6) 


-00 -00 


00 X 


> ! - J J C*<x> - *<y>) k " Z ^<y> 4><x) dy dx 


-oo -oo 


(from Lemma 3.4.1) 


= 1 


1 

k(k-lT ' 


2 _ 


With equality holding if and only if ^ j ••• k 

Lemma 5.4.1). Thus, the result follows from Theorem 5.4.1. 


(in view of 


Me conclude this section with the following remark.*. 

Remark! . From (5.4.6) we can see if the parameters Sj \ «* 

2 -nrt are relatively 

close together, and if variances o^) <1> 

.. _ — i a nr p s and simultaneously if 

small in comparison with other 

o 2 4 .L, an th p rule <5 N,t performs 

m* is relatively larger than then the ru 

, eihich selects at random. IWaw^ ^ ^ ^ 
worse than the rule which seie 

a, B ’hi- 4 — -i < 

tU-v^cw-L. 2. ■ g-eotAtte 4 ^ <r v 

0^ ctcY^lX^"^ ^ aw ^ c45 ’ 

•umuw*, xt, «o w 



CHAPTER IV 


Simultaneous Selection of Extreme Populations: 

Optimal Two-Stage Procedures 

For the problem of selecting the UEP in two stages, 
Gupta and Miescke (1984) have derived an essentially complete 
class of two-stage procedures for a general loss function. In 
this chapter we consider the goal of simultaneously selecting the 
LEP and the UEP in two stages: screening out non-extreme 
populations at the first stage and seleclmy I wo pupuliil ions 
associated with and the second stage. In Section 4.1 

we formulate the problem and give the definition of two-stage 
permutation invariant procedures. In Sections 4.2 and 4.3 we 
derive two-stage Bayes and two-stage permutation invariant 
procedures . 


4. 1 Formulation of Problem 

Suppose that the observation X i f rom n . has a normal 
distribution with mean <-® < © i < oo) and common known variance 
c/ Z ( =1, without loss of generality ), i = l,...,k, k > 3, and 

suppose that r.v.’s Xj X k are independent. We are interested 

in deriving an optimal two-stage procedure for the problem of 
simultaneously selecting the LEP and the UEP. We will consider 
the following class of two-stage procedures : 

At stage 1, observe ^ rorTI n i ' 1 ~ * anC * 

based on these independent observations select two non-empty and 
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disjoint subsets S,_ and S y . If | S,_ } = Jsj = l, then procedure 
Stops at stage 1 and claims that populations is S L and S y 
correspond to a £1] and 6 Ck] . respectively. In all other cases 
procedure proceeds to stage 2. 

If at stage 1. |Sj = 1, 2 < |S U | < k-1 < |S y | = 1, 2 < 

| S y | — k-1. ), S y n S y = <p , then procedure claims that population 

in S y (S y > correspond to anc * decision about population 

corresponding to is made after taking n,, additional 

observat ions V Y from each n , i e S. , < l e S. ) . 

1 1 l n^ i U L 

If at stage 1. 2 < fSj, | S u | < k. 4 < | S y | + \S U \ < k. 
S L n Su = <p , then n^ additional independent observations are 
taken from each i e S y u S y and final decision is based on two 

samples from each i e S y u S y . Let U. = X^ ... • in 


+ ... + X ; n and 
"l 


V = Y. . + ... + Y 

l 1 1 in. 


, i = 1 k be sufficient statistics for 9 


at stage 1 and stage 2, respectively, and suppose that f(.;©j> and 
ht.;^) denote the pdf's of U j and VL . i = respectively. 
Thus 


f <U . ; 9 . > 

l l 


Ylnn, 


exp 


(- 


Tn7 ^ u i" n l®i^ 


)• 


and 


h<U . ;9 t ) = 

1 

VZn n^ 

exp £ - 

2 n 2 

)• * 

= 1 . . 

. . ,k 

Let W. = U. + V 

l l i 

. u 

= <u r 

v = 

K ^ 

( Vj ♦ . . . • v 

> and W = 

K «v 

(Wj W k > be 

the 

joint 

sufficient statistics 

for 9 = 

(Sj e k >. We 

will 

consider only those 

deci s i on 

rules 

which 
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depend on observations only through sufficient statistics, 
order to define a two-stage decision rule, let 

v = c Vtl s,t = 1 k * 2 " s+t ^ k > 

where for each s.t = 1 ..... k , 2 ^ s+t £ k , v is a measurable 

S | t 

k 

map from R to [0.1] with the interpretation: after observing U = 

IV 

u. v t <u) denotes the conditional probability of selecting s 
populations in S L and t populations in S at stage 1, given U = u. 

^ IV IV 

Let 


i?<u> = Ci 7 s t < (aj ,a 2 > | u> :aj ,a 2 c 11 kl, a^ n a 2 = 4 > . 

1 a^ | = s, | | = t, s.t = 1 k, 2 < s+t < kl. 

where i) s t is a measurable map from R to [0,1] with the 
interpretation that r) . ( (a. ,a ? ) | u> denotes the conditional 

S ( t X C- M 


probability of selecting subset pair (aj .a^) with |aj| = s, | a^ | = 

t, having observed U = u at stage 1. 

If v(u) decides that jSj = | S u | = 1. then procedure 


stops at stage 1. and a final decision is based on 

Cl), (<Ci>.Cj>>|u). l.i = 1 ..... k • » * 

In all other cases procedure proceeds to stage 2. If at stage 1 ~t) 
selects S L = t i } . S y = C j j i t > with ] j < . . < j t . 2 < t i k-1 . 

S L n S U = * <S L = Cl l V* S U = Cj} With 2 - s ~ 

k-1, S. n S.. = <p ) then after having observed V. = v V. 

1— U 1 1 ^ 

v. (V. =v ... V. =v ) at stage 2, final decision is based on 
1 1 1 1 1 1 ’ 1 s 1 s 


C6 . 

l 


hj* 6 V <t4 <..i.s L .Ci> < - iV ' 1 


( u ; v . , . . . ,v . ) 


l 


i € S L )>. On the other hand if at stage 1 7? selects S,_ 

{ i j ..... i g ] and Sy = SyOSy-^with i^ < < s’ 
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J 1 < 


< J t . s.t >2, 4 < s +t < k, then 


after 



decision is based on 


V 



having observed 

v, . the final 
't 


C S 

. ] 


where 


c ; V 

• b u ~ 


1 



>1 


L * 


S U } 


<5 


C 6 

i 



a l 1 5 € a 2 ' a i ’ a 2 c <1 , . . . ,k) , 

a l n a 2 = 5 < jaj + |a 2 | < kl 


6 

that 


i t ] * s j 


k |a,|+|a I 
is a measurable map from K x R L 


to [0,1] such 


2 2 i i I ,3. , a_ 

ieaj ]€a £ 


Definition 4-»l»l t The triple will be referred to as 

two-stage decision rule (procedure), where v, r ) , 6 are as 

explained above. 

Let X> denote the class of all two-stage procedures. 

Def ini t ion 4,1.2 * We will say that a two-stage procedure (i^,r),<5) 
is permutation invariant if 


(i ) 

v . <u> = v . (gu), V g e G, 

S » X S | t 

V s.t e Cl kl, 2 < s + t < 

k, 

(i i ) 

V s , t e Cl,.. 

. ,k> , 2 < s+t < 

k , aj ,a 2 c Cl , . . . ,k> , aj n 

a 2 


= <p with | a j j 

= s. |a 2 | = t. 




"s,t <<a ] ■ a 2 > l“ ) = ’) s .t <<Sa l’ 9a 2 > l 9 “ > ' W 9 * G ' 


(iii> for aj = Cij,...,i g }. a^ = with ij < ... < i g 

and jj < ... < J t ; 9a ^ = {ij.....i g >. 9 a 2 = Cjj,...,i^} 

with i'j < ... < i g and j ' < ... < j' t < 


6 . 
l 


.a, 


,^ ;V gi 



9) 


> 


t 
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~ 6 gi .9) .ga ga , <9 “ :V ', v ' : v'. v' ) 

1 c 1 s 1 1 ’ t 

Let £> r denote the class of two-stage permutation invariant 
procedures. Let t be a symmetric prior on Ci — [R^ . Let 

L<0. <aj ,a 2 > , l , )) denote the loss incurred in selecting subset 

pair (aj . a^ > at stage 1 and then finally selecting populations nr 
and as the LEP and the UEP. respectively. Assume that 

L<e, <aj ,a 2 > , l , j ) = L < g© , ( ga ^ , ga £ ) , gi.gj), V g e G <4.1.1) 

In addition to <4.1.1), suppose that the loss function 
satisfies 

<a> L<© , < 1 1 1 , t ) )) . l . j ) < L(0 ,( C i '},{)}), i j ) , for 

e i ~ e i' 1 * i • »' * J • 

(b) L<©. <Cil.Cjl) . l . 1) < L<©,<{ 1 >, {j'}), i , j' ) , for 

A/ 

e } > e jt , i * j , i * j' 


<c) L<© , <a^ ,a 2 ) , l , ) ) <L<©,<aj,a 2 > t i',j) t 


for 


©. < ©., i.i' € aj, j <= a 2 , aj n a 2 = ^ 


<d) L <0 , < a j , a 2 ) , l , ] ) < L<© , <aj , a 2 > . 1 , j ' ) , 


for 


0 } > 0^ , i e a r j. j' c a £I a> n a £ = <p } 


(©) Pop si ^ ^ Cij 9 • • ■ « 1 j 1 1 5 ^ ^ J j * * * • » ] j * i j 

Cij 1 r-1 , i ' > , a £ = Cjj ) s-l’ ,,> With a i na 2 = 

M A/ ^ ^ 

a l ^ a 2 = ^ ' a l ^ a 2 = ^ ' a l ^ a 2 = <p < 

A/ 

< 1 ) L<0, <a } ,a 2 > ,q,m) < L<0, <aj .a £ ) .q.m) .for © i( >© t 

< 11 ) L<0, <aj ,a 2 ) ,q,m) < L<© , (aj ,a £ ) , q ,m> . f or 9 { > 9 

<iii) L<0, <a } ,a 2 ) . i ,m) < L<©, <aj ,a 2 > . i' ,m> , for © t < 9 

< i v) L<0 , <aj ,a 2 ) ,q. J > ^ L<0, <aj .a^) ,q. j' > . for 9 .> 9 jf 


<4.1.2) 
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Under the above set up we will first find optimal second 
stage decision rule 6 and then the optimal two-stage decision 

rule. 


4.2 The Optimal Second Stag e Decision Rule 


For every s,t € Cl 


,k> , a 2 ,a £ c Cl 


, kl , aj n a^ 


4> 


with | a^ | = s, |a 2 | = t and u e R k , define 


7? s.t <<a l* a 2 ) l^> = \ 


j. 

'TTTsTtTf • 


o . 


if (a. ,a, ) e H ( s , t > 
1 Z u 


otherwi se 


where 


H u <s,t> = C<a 1 ,a 2 > : jaj = s . | & 2 1 = t. a 2 n a £ = <f>, u j < u q < u^. 


V 1 € a l * I ea 2 , qeajnaj). 
= C ] , , with i, <...< l ; 

1 L 1 C 

k • R s , 


Similarly for a^ = Ci^ i s > . i 

jj <...< a^ na^ = <p . s.t > 1, ueR , <v t , > 

(v v. ) eDR*". Wj = u. + v., 1 e a. Ua 7 . define 

J 1 J t ill i L 

6 i i a a <u;v i V i ; V ] V ] } 

* 1 ,a l ’ 2 ~ 1 s 3 1 J t 


- 


1 

I c s t a a <W i ;w i w ] > l 

s,t ' a i * a 2 i 's 3 1 J t 

if <i.j> e C <w w ;w w .) 

s,t,a 1 .a 2 ij i s jj J t 


0 , 


otherwi se 


where 
C 


<4 . 2 . 1 > 


t „ . (w w - ,w, W ) = {(i.D.Wj = min fw iq 6 aji 

. t ,a j . a^ ij i s Ij l t 

and w. = max Cw :q e a- 3} 
J q 



120 


Now, the risk of a procedure at B e f> i 


s given by 


R(0, (v,r?,6) > 


k k 


2 2 E e [k (U)r?. .<<{!>, tj})|U)] 

i=l j=l ~ ' ~ ~ J 


k k-1 


+ 2 2 E e C v l , t ^ > ) 

. 1 1-0 Cm 


1=1 t =2 


a 2 :a 2 = f J 1 J t * 

Jq*! .q=l t 


77 j >, a 2 )| U ) 


2 L< !' <£ '’^ 2 >. '•<> 6 ,, 1 .U).a 2 ( ^ U , 1 v j t >] 


k-1 k 


+ 2 2 E e l ",.!™ 

S=1 J=1 




a l :a l = cl l ig> 

lq^j ,q = l S 


2 L< ?' <a l ■ 1 1 J > . i . j ) -s, , tj) <u,v v . )] 

■ i Is 


k k 


+ 2 2 E e 


s=2 t=2 
s+t<k 


Vt ^ Wl ^ 


( a 2 , a 2 ); a 1 = {ij i g } 

^2*^ j j * * * * 1 ] ^ 1 


2 2 L<0, (aj .a^) , 1 , ) > 


i€aj jea 2 


<U;V. V. ; V V. >1 

*• J-V a 2 ~ *1 l s J 1 J t J 


The Bayes risk for < a-* , rj , <5 > under prior r is given by 


r<r , (i> .j) ,6 ) ) = J R<© , <v» ,T? , 


6)) dr (0) 


(4.2.2) 
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Let r u < <v,t 7,<5>> denotes the conditional posterior risk of a 

procedure given U = u. In order to find a rule which 

minimizes ( 4 . 2 . 2 ), it is sufficient to find a rule which minimizes 
r ( (p ,77 ,6 > ) for every u e 0? . Now, 

r*( (p ,77 ,< 5 ) ) 
u 

= Dj <u , <v ,77 ,6 ) )+D 2 <u, (p ,77 ,< 5 ) )+D ? (u , (p ,77 ,<5 > )+D 4 ( u . (p,77.6) ) 

(4.2.5) 


where 

Dj (u , (p .77 ,< 5 ) ) 

k k 

= (u) 2 2 - 1 . 2 (( (i },{)}) |u)E [L (0,({i 5, f jl).i , j)|U=u] , 

i=l j=l 

D,(u. (p.77.6) ) 


k k-1 

r* 

2 2 
1=1 t=l 

1 

a^ : a^- ( i j * • • • * J ^ 


) *i ,q=l t 

e[ 2 

6 r , (u;V ,V, 

1 , j , C 1 } .a^ ~ 1 2 > 


77j t ((Ci>,a 2 > |u) 


jea. 


Dj(u , (p ,7? ,< 5 ) ) 
k k-1 
- 2 2 


77 s 1< , l j J ) | u> 


s=2 j=l 


a l :a l = U l ‘s } 

1 * j , q=l s 

q 


cr V 5 < U ;V V. ) L(©,(a ,C)}).i. j>|U=u], 

L l 1 , j ,aj ,C j> ~ ij l s 


lea 


1 
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and 


D.(u, (v>,r?,< 5 ) ) 
4 ~ 


k k-1 
■ 2 2 


s = 2 t = 2 
s + t<k 


} 




(a. ,a,) :a = Ci l > 

1 L 1 1 S 

a 2 =C j j J t > .ajDa^s^ 


t 2 2 6 i , ) .aj . 


(u;V V, ; V V. > 


l^a 2 j«=a £ 


a 2 *1 


's J 1 


L<6, (a 1 .a 2 >. i . j>|U=u] , 


Now since our loss function satisfies (a) and (b) of (4.1.2) 
Lemma 4.2 of Eaton (1967) is applicable. Hence 


D. (u , (v .17 ,6) ) 

A 


k k 


x> 


i i (u) 2 2 77 1 i <({l} ' {j)) l^ E[ice,((i>.f j>>. > . j) | l J-'j] 


1=1 j-i 
i* ) 

k k 


> „ 1 1<U) l l T,* , < < t i J . n»|u> E[u<e,<t. >.<!». i.l>|U*u] 


i =1 j=l 


... (4.2.4) 


For aj = Cij i g >. a 2 = { j l j t >,a l n a 2 " I a l 1 * 1 a 2 1 


Writing 


D (u, (a. . a. ) ) 
s,t „ 1 c 


a v . U -v v )L<e,(a ,.a 2 ) ,i , ) > | U-u] 

V 5 ( u ; V . .....Vj * v j ’• 4 ~ 1 ^ ~ ~ 

2 l.) .aj .a 2 ~ »! s J 1 t 


i€a^ )ea 2 
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we have 


D . (u . (i*> ,r> ,<5> > 
4 „ 


k k 

' I 1 v s.t (U J 


s=2 t=2 
s + t<k 


^ a l ’ a 2 ^ : a l _ ^ 1 1 1 ^ 

a 2 = f 3 j ) t > .a^a^# 


? s,t <<a l’ a 2 > h >D Stt <a r a 2 >> 


(4.2.5) 


Now 


D s.t ( ^ <a l ,a 2 ) > 


J 


J 5 6 i i a a (U;V 1 V i 5 V, 

xu Zu i ♦ j td, , a 9 ^ i i i 

+ |aj iea, jea. 12 1 81 


K 


a j I + I a £ j leaj j€a 2 


,V. ) x 


f k 

■jf L(0, (a .a > , l , ] ) n f(u n ;6 ) n h<V ,9 >dr<e> 

I-' ~ J c . q q q q 

l y q=l qea Ua„ M H 

ER k 1 z 


n dV x [m(u>] 


-1 


q€a ^Ua 2 


where 


m(u) = f f (u ;& >d x(0) 
J q q 


[R 


Using Fubini's Theorem, we get 


-} 


D s.t<“' <i V a 2 >> 


-Si l 6. . <u;V, 


k i«a. j€a. 


1 ' 1 ,a l ,a 2 ~ *1 


■V, = V V > 

*s J 1 J t 


IR 1 


{■f 

v. V 
IR 


L<e.<a r a 2 ).i. j) £f(u q ;© q )h<V q ;© q )>dr<©> 


!>} 


n dv X Cm(u>] 
. r 
r=l 


-1 
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J~ y y <5 , _ (U;V V ; V V ) 

J ^ A 1 , ) ,a a i l 1 , J + 

k 1 SI t 


R k i«aj J « 2 


{ J 

K 


J L <0 , <a j , > . i . J > (2rrnp 

k 


rv 

e * p (' I 7 TT I W>) 


q=l 


C p O N 1 k N> n 

exp - — y - - ) 6 C dT(e>l n dV r [m(u)]“' i 

v. * ~ J r=l * ~ 

q=l ^ 


where 


m(u) = J e ><P ( J e q Cu q - -j ] dr( 0 >. 


R 


k q=l 


On substituting u + V = w in D . (u , (a, ,a, ) ) , we get 

q q q S f c„ i c 


D . (u , (a, , a 0 > ) 
8,t 1 Z 


J C 2 nnp 
R k 


exp [‘ 2 nt I < V U q >2 ) 

q=l 


^ T 6. < u : w -u w -u :w -u. 

Z Z i . ] . a j , a^ ~ 1 j 1 j s s 1 1 


U, w, -U. ) 


J t >t 




{ J 

v. u 

R 


L<0. (a } .ap , i , )> 


k 

** P [ l ®q “q ] r ^ d “. 

q=l 


Cm(u> ) 


-1 


where dr(©) = expf J 0 q ] dr(0). 

q=l 



1 ?v> 


Note that dr(0) is also symmetric in ©. 

For a j * a £ ^ C 1 , . . . , k) , a ^ « 3> £ ^ $ * & j ^ a ^ = <p , define 

k 

Ej ( (a^ « a.£ ) * 1 * 5 | w ^ = X L( 6 f (aj,a 2 >,i,)) exp ^ ^ 0 ^ w q j dr ( 0 ) 

q r 1 


CR 


Then 


D . (u,(a. ,a^)> 
s , t ~ l £- 


-- J ( 2 r,np 2 exp[- -±- l %-up 2 ] 


or 


q=J 


Y Y <5 (u : w 'U, w. -u. ; w -U W -u. > 

L Z i . j , a j , a ^ ~ i j 1 j 1 s s * i i t t 


iea^ jea^ 


r\ <v 

E. <<a. ,a ? ) . i , j) |w) n dw [m<u>] 

l l l. ~ r = l 1 


-1 


(4.2.6) 


Now we prove the monotorucity of Ej ( (a^ ,a^) . i * J | w) . 


Lemma 4.2.1 * Suppose i. 1 ' e a } . and j,)' e a £ . then for every 
f ixed w e , 


(i) 

,a 2 > , 1 . ) |w) 

> E, ( (a. ,a 9 ) , i' . j |w> , 

lie ~ 

if w } > w., 

( 1 i > 

EjCta^ ,a 2 > , l , j jw) 

> E 1 <(a 1 .a 2 >,i, )' |w). 

3 

Ai 

3~ 

4~ 
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Proof t 


(,) E 1 (<a 1 .a J >...,lw> - E J <<a r a 2 ).,- . , 


J <L< ® ■ <a j ,a 2 > , i , j )-L<e, ( aj ,a 2 ) , i' , j> ) 

k 


w -.e >o , } 

~ i i 


eXP ( I ®q “q ) dr<8> 
q=l 

+ J <L(0 ’ <a l ,a 2> ’ 1 ’ ] >" L<0 - (a j > a 2 > ■ i' . ) > > 

k 


{. 0:0 =0 , } 
„ 1 1 


(I® q-,] 


exp | ) e_ w_ | dT(0) 

q=l 


+ J <L(©.(a 1 ,a 2 ),i,]>-L<e.<a r a 2 ),i' , j)> 

10:0 <0 . . } 

I 1 

k 

6 * P ( I 6 q W q ] dT< ® > 

q=l 

Since t is symmetric, the second integral is zero and the roles 
of 0. and 0 , can be interchanged in 3rd integral so that 

Ej ( (a^ ,a 2 > . l . j |w> - Ej < (aj ,a 2 > , i' , 1 |w> 

k e q w q 

= f <L(0.(a, ,a ? ),i. J)-L<0,(a 1 ,a >,i' ,j)> n e 

J ~ XL ~ xu q = 1 

19 t& ^ >9 i , > cp* i , i ' 


6 . w . 9 

[e 1 1 e 


w 


0 . # w 
i # l 


e 


9 . w . 
i l 

e 


] drW) 


> 0 (on using MLR property and property (c) of <4.1.2>) 
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< i i > 


E 1 ( (a l ,a 2 > ’ 1 ’ ] I?* " E 1 ( (a i ,a ?> - 1 • J* |w> 


J ^(©.(a^.a^.i.jj-Lte^aj.a^.i.j' )> 

w-.e ,>e } 

J ) 

k 

** P [2 ®q "q ] *<?> 
q=i 


+ J 

C &:& )t =9 


< L <&' , i , ))-L<9, (a } ,a z > , i , )' )> 
} 


exp 


( 2 “q ] 

r-i= 1 


dr (©} 


+ J <L<0, <aj ,a 2 > , l , j)-L(©, <aj ,a 2 ), i ,)' )> 
w-.e , <e } 

J J 

k 

e * p ( 1 e q w q ) d ^ ( ! > 

q=l 


On using invariance of r and interchanging the roles of and 

9 in >rd integral, we get 

EjUaj ,a 2 > . i . j |w> - < <a^ ,a 2 > , i , j' | w) 


J 


w-.e , >e > 
i j 


(L(0 , (a, ,a, ) , l , J > - LC0, (a. ,a 2 > , i , )' )) n 
~ -i L ~ q=l 

q*j . )' 


e w 
, q q 


e w j e.,o> e i w i'- 

j- e 3 e J 1 - e J 1 e 1 * ] dr<©> 

> 0 (on using MLR property and property <d> of <4,1.2). m 
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Lemma 2» 2 I For a ^ a. ^ = { j 


a n = 4> and for every 6 
1 2 


D t.t < “- <a l' a 2 >) - D t.t C ^- <a l- a 2 >> 


£ 2 , 


C4.2.7) 


where 6 is same as defined by (4.2.1). 

Proof i On using Lemma 4.2.1, it follows that for every fixed 

w c 0? k 


1 1 

ica 1 ]<£a 2 


(u;w. -u . w -u ; w . -u w, -u. ) 

i’ |,a l ,a 2 " ‘l ‘l ‘s ‘s ] 1 J 1 ] t J t 


Ej < (aj ,a 2 > . i , j | w) 

> X X 6* ( U ; w -u W -u ; w -u. w. -u. ) 

Z L i . ) , a j , a £ „ 1 1 ij * s ig jj J t J t 

lea^ jea 2 

E ][ ( (aj ,a 2 > , l . J | w) 

Now the result follows from (4.2.6). B 


For i,j = 1 k, a^ = 




2 < s < 


k-1, 2 < t < k-1 , l * a £ , j a - l . let 


Dj t <u.<Ci}.a 2 >> 


E ^ i , ) , C i > , - 2 


( u ; V . V 

’ a 2 ~ >1 3 t 


) L(0. (Ci>.a ? ) , i , j>|U=u] 


jea, 


and 


D“ j(u, (a x ,{)})) 


= E 


a 


Hea* 


. (u.v, V, > L<e.<a,.Cj».i.i>|U-u| 


1 t J ♦ a j , 1 3 } ~ 1 1 s 



129 


men 

D 2 <U , <v ,7} ,6) > 

k k- 1 

i — l "t- 2 a 2 : a 2~ ^ 1 1 1 * " " ' 

j q *i ,q=l t 

t (u, (Ci },a 2 >> (4.2.8) 

and 

Dj(u. (v .t? ,<5 > > 

k-1 k 

' 2 2 } ’>s,i ((a r C|5> l“> 

5 = 2 J = 1 a l :a l = Cl l i s > 

i q *j .q=i s 

D 6 , (u, (a, ,C j>)> (4.2.9) 

s , 1 „ i 


Now, 


D" t (u,<Ci}.a 2 )> 


J CZ,n 2 >‘ ^ «p(- ± l C q V) 

k c ’ =1 

R 


2 

j^a. 


, (u;w . -u . , • • • .w _u , > 

l , j , C i > , a 2 ~ J j J t ] t 


E. < < Ci ) ,a ? > . i . ) | w > n dw r [m(u)] 
1 L r = l 


-1 


and 



k. 

2 


1 50 


Dg j>)> 


X C2nnp 
R k 


°* p [-nk 2 C VV 2 ) 

q=l 


1 

lea 


6 

1 • l.a 2 





> 

s 


•())),!,) to ) 


k 

n 

1=1 


dw^ [m(u)] 


-1 


The next lemma is an immediate consequence of Lemma 4.2.1. 
Lemma 4.2.3 * For l . l ' « aj . j . ]' e a £ , l , i' e? a £ and j , j' <z a } , 

5 6* 

( i > D s. 1 <a l * C ] }> * " D s 1 <u ’ <a l * { j}>> • 2 - s - k -1 , ( 4 . 2 . 10 ) 

6 &* 

(ii) Dj t <u , < 1 1 } , ap > > D° t <u, <{i>,a 2 >), 2 < t < k-1 , (4.2.11) 


The following theorem proves the optimality of the decision 
rule 6*. 

Theorem 4.2.1 s Let r be a symmetric prior and suppose that loss 
function L satisfies (4.1.1) and (4.1.2), then 
( i ) r (t , (v> , r) , <5* ) ) ^ r (t , (v ,r) ,6) > , V (^ , 1 ? , <5 ) e D 
and 

(n) R(©, <v,», 6 *)> < R( 6 , iv,r),6 >) , V (v, 7 ), 6 ) e Dj 

~ ~ # 
where n is same as 77 except i = ^],1‘ 

Proof * 

A/ 

< i ) From (4.2.4) and from the definition of r>. it follows that 

Dj (u. (v, 7 ), 6 ) ) > Dj <u, (v, 7).6>> . v (v>,t). 6 ) e t) 


(4.2.12) 
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Also from (4.2.5) and (4.2.7), we get that 

D, (u , (v> ,r) ,<5) ) > D. (u, (i>,7),<5*) ) , V (i>,77,<5) c. 3D (4.2.15) 

» +* ^ /v 

S i mi lar 1 y , 

D 2 (u. (v.r?.«5) ) > D 2 (u, (v,t). 6*) ) , V (v,r),<5) e X> , (4.2.14) 

(from (4.2.8) and (4.2.11)) 

and 

D, (u , (v ,r) ,6 ) ) > D,(u, (v,r),6*)) , V (v>,r?,<5) e D (4.2.15) 

/ /V / IV 

(from (4.2.9) and (4.2.10) 

Now on using (4.2.12) - (4.2.15) in (4.2.5), we get 

r*( (v ,T) ,<5) ) ^ r*( (t? ,7) ,<$*> ) 

A/ 

which proves the first assertion. 

( i i ) For <v ,7) ,6) e £>j 

R(0 , (v ,7) ,<5 ) ) = R(g© , (v,T 7 ,6) > , V g e G (4.2.16) 

A/ 

Fix © e D? k and let t be a prior which puts equal weight on each of 
permutation of 0. Then on using (l), we get 


* J R(g0,(v.5.6*>) < ^ R<g ! 


— > R(0 , <v , 7 ? ,6*) ) < R(0 , (v , 7 ) ,<5 ) ) , V (v,7),6) e X> j 


(from (4.2.16)). 



152 


4. 3 Tho Optimal Two-s tago Decision rule 

Now for 1 < s.t < k-J, 3 ^ s+t < k. we can write 


D . (u, (a. ,a.>) 

S t t /v 1 £• 


- / { mi 
, k '■ ,ea r 


Min L<©, <aj ,a 2 > . l , j > exp [ \ e q w q ] dT< ^ ) |’ 


jta. 


R 


q=l 


(27in 2 ) 2 expj^- ~~ J C w q - U q> 2 ) [J dw r [ m<u> ] 

2 q= 1 r ~ 


-1 


Define 


L <w, (aj ,a 2 > > 


min 


iea. , jea ? . 
i c R K 


J L<e.<a 1 .a 2 ).i. 3 ) exp ( J e q w q }*” <?> 


q=l 


= min E j ( (a^ ,a 2 > , l , j j w) . 

i«aj , jea^ 

The following lemma proves the monotonicity of L 


Lemma 4.3.1s Let a, = Ci, a 2 ' { ’ 1 ’s-l 5 ’ 5, a l 

/v ^ 

Cij a 2 * <>! i a l M a 2l * l a l I ‘ l a 2^ ~ 1 ' 

r+s > 3. with n a 2 = 4>, & l n a- z = <f> , aj n a £ = 4>. a ! n a 2 4>, 
then 


(i) L*<w, <a^ ,a 2 > ) — L <w,<aj,a 2 >). if w j* > 

<,1> ‘f w , 2 w i' 


Proof * 


(i) For l <e aj , ) e a 2> n a 2 " 
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Ej < (aj .a^) ,q,m|w> - E j ( (a^ , a^ > , q ,m| w) 

J [L(0,(a 1 ,a 2 ) ) q 1 m)-L(e i (a ] ,a 2 >,q 1 m)] 


w-.e , >© > 


CXP ( 1 ®q "q ] d ^!> 

q=l 


J [L(© , (a^ .a^) , q,m)-L(©, (aj , a,,) , q,m>] 


C©:© , -e ) 

i l 


6XP ( 1 e q W q ) dT(e> 

q=l 


+ J [ L< ®* <a i • a 2 ) «q*m)-L(©. (a } ,a 2 > ,q,m)] 


C ©:0 , <0 } 

~ l l 


6XP ( 2 *<, “q ] < * < ! > 
q=i 

Since t is symmetric, the second integral is zero and the roles of 
0 1 and © jf can be interchanged in the third integral so that 
Ej < (a^ .a^) ,q,mjw> - E^ ((a^ .a^) ,q,m|w> 

~ k © w 

= J* [L(©, (a^ , a,,) ,q,m)-L(©, <aj ,a 2 > , q,m)] n e q q 

t©:© , >© } ~ T 1 ■. 

i i q*i , i' 

E ll l' 1 11 1 It ,qs 

e e - e e J dr(©) 

J A# 

> 0 , if w , > w. 

i' i 

(using MLR property and property (<e> <i>> of (4.1.2)) 
Again using the same argument, we get 

E J ((a 1 ,a 2 ) , i* ,m|w) - Ej ( (aj ,a £ > , l ,m| w) > 0 

( 11 ) Follows in a similar manner, m 
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Now we present the main theorem of this chapter. 

Theorem 4. 3. 1 t Suppose t be a symmetric prior and suppose loss 

function L satisfies <4.1.1) and (4.1.2). Then 

<i) r(r,(v t T j*,6*)> < r<r , (u,n ,6} > , V 6) e Z> 

and 

<ii) R<0. (v.t)*.< 5*) ) < R<e, (v.T 7,6)) , V <u,»,6) e 

Proof * From Theorem 4.2.1, we have 

r(r , (.v ,r) ,6*) ) < r <t , (u ,77 ,6 ) ) , V < v,r},6 ) e J) 

(4.5.1) 

For s.t > 1, 5 ^ s+t £ k, consider the problem of partitioning 

Cl kl into three (two) disjoint subsets of sizes s, k-s-t, and 

t <s and t) with s+t < k (s+t - k). Using Lemma 4.2.5, it is easy 
* 

to see that L <«,(aj,a 2 )) has the property of the loss function 
assumed by Eaton (1967). Hence for 1 < s, t < k, 1 S s+t < k, 

]> 7 ’s,t <(a l' a 2 > ^ ) D s , t ^ ’ ^ a l ' a 2 5 } 

(aj .a 2 > : | a^ |=s, 

Ja 2 j =t ,a 1 na 2 =^> 
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Vt <<a l> a 2> 


u> 



<«. ( &1 ,a 2 > > (2rrnp 



k 

n do> 

r=l r 


[m(u)]" 1 



} * <5 

7? s,t <<a l ,a 2 } l u)D s t <u - <a l- a 2 >) <4.3.2) 

< a l ,a 2 } : I a l I =s ' 

I a 2 I =t ’ a i na 2 = ^ 

Now the result follows from (4.2.3), (4.3.1) and (4.3.2). H 


Corollary 4.3.1 t Under the assumptions of Theorem 4.2.1, if for 
a given T) (.u ,t) , <5 ) is m i n i max in Cj , then ( v , tj ,<5 ) is minimax 
in £>. 

Proof. Since the group of permutations G is finite, the result 


follows from Blackwell and Girshick (1954, 


Chapter 



22 3 - 22 ^ 


We cone 1 ude this chapter with the following remark . 


Remark. Let the observations from n have a density C(© > 

l l 

exp(© x> b(x> with respect to Lebesgue measure or counting 
measure, then as in Gupta and Miescke (1983), all the results of 
this chapter can be generalized to the case where the underlying 
density is strongly unimodal. 



CHAPTER V 


StLLCTINO THE BETTER OF TWO BINOMIAL POPULATIONS : 

Optimal Decision Rules 


5. 1 Introductio n : 

Let rt 1 n k be k<> 2) independent binomial populations 

with single trial success probabilities ©j © k respectively. 

Let n. be the number of independent observations from n , i = 

1 k - The 9°al to select the UEP (the population associated 

wi th and ) . 

For selecting the UEP, Sobel and Huy e 1 1 (1957) considered the 
problem of finding a smallest common sample size such that the 
probability of CS is more than or equal to a specified P* (-i < P* 
< 1) for a specified indifference-zone. Later Hall (1959) proved 
that the rule proposed by Sobel and Huyett is minimax for equal 
sample sizes. For the case of unequal sample sizes Gupta and 

Sobel <19^8, 1960) suggest a decision rule which selects the 

population corresponding to largest sample proportion of successes 
as the population associated with © We call the decision rule 
proposed by Gupta and Sobel as intuitive decision rule. 

Note that for k = 2 , the goal of simultaneously selecting the 

LEP and the UEP is equivalent to the goal of selecting 

UEP. 

Risko (1989) considered the problem of finding a minimax rule 
for the case of k = 2 binomial populations with unequal sample 
It was observed that intuitive decision rule performs very 


sizes . 
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badly when one sample size is very large compared to the other. 
For this case Risko suggested a decision rule which is minimax 
when one sample size goes to infinity with other sample size 
remaining fixed and finite. For the case where both the decision 
rules result in Pg(CS) less than i a class of decision rules which 

depends on two parameters is given and an attempt is made to find 
a minimax rule in this class. It is observed that this restricted 
minimax rule possesses many properties consistent with globally 
minimax rule and that it is in fact globally minimax for certain 
configurations of sample sizes. 

Following Risko, we consider the problem of character i ✓ i ny 
minimax rules for selecting the better of two binomial populations 
with unequal sample sizes. We derive some necessary conditions 
for a rule to be globally minimax. Several numerical examples are 
also considered. 


5.2 Formulation of the Problem : 

Let fij and n 2 be two independent binomial populations 

with single trial success probabilities ^ and e, and sample 
sizes nj and n 2 respectively. Suppose Xj and X 2 denote 
independent random variables representing n, and n 2 respectively, 
□ur aim is to select the population associated with larger of Sj 


and 9 


Ul tu w 2 • 

Here, a decision rule « is a map from (0.1 - 

( 0,1 n 2 > to tO.lJ with the following interpretation = 
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If Xj = l and X £ = j is observed then <5(i,j> e [0,1] is the 
probability of selecting n and l-6(i,j) is the probability of 
select i ng . 

n l ’ n 2 

Let 2> denote the class of all decision rules for the 

problem at hand and let 


v n i ' n 2 


n l ,n 2 


3>j 4 = {<5 e 3) 4 : <5(i, ]> = l-SCnj-i. n 2 ~j>} 

n i ’ n o 

Risko (1985) proved that class is an essentially complete 

class for finding a minimax rule. Let 


f n, * n. 

i . < 0 . > = [ 1 e\ <i-e. > 

n j • i i L i J 1 i 


. i = 0,1 n. 


B .(0,) 
n 2 ' 2 




3 n 2 _) 

0’(l-0 2 > 4 , ]=0,1, n £ 


Let P(CS|6> denote probability of CS using rule 6 and suppose 


Q(6> = Pg (selecting using rule 6) 


n l n 2 

= \ 7 6<i , )> B (0. > B . <0, > 

L L n. , i 1 n 2 , j 2 

1=0 J=0 


where © = <0j ,& 2 ) 


Q(<5> = min P^(CS|6) 


l e r e 2l- d 


= min -T min Q(<5> , min (1-Q(<5>)}- 

_l. j-J Ck 


0j>e 2 +d 


0 2 >0j+d 


where d (0 < d < 1) is pre-speci f ied. 

n l ,n 2 

We desire to find a minimax rule in 2) , that is, a 6 { 


"l ,n 2 


such that 
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Q(& o > = max Q(< 5 ) 
n l ,n 2 


< 5 e 3 > 

In the next section, we give some necessary conditions for 
a rule to be minimax. 


5. 3 Some Necessary Conditions For Mini maxi ty 

n i , ru n - , n a 

Let 3 > c 3 ) consist of the <5 's for which Q <<5 > 

o o o 

— n i ' n ? 

= max Q(d) , that is 3 ) is the class of minimax decision 

n ,n 

6<a2> 

rules. Then we have the following lemmas : 

n, ,n„ 


Q <6°*> 
o 


• 1 : 

3 ) 1 ‘ 

is a convex set. 


o 


Let 

6 °, 6 • 

n . , n a 

e 3 ) and 0 < oi < 1 . 


O 0 

0 


o 


< 5 °* = 
o 

a, 6 ° + 
o 

(l-a) < 5 ^. Clearly < 5 * e 

n l ’ 

n E 


i : 

l <“ 6 °o 

(i , j) + ( 1 -cO < 5 ' q (i , j>) B 

i=0 ] 

= 0 


n l 

n 2 


- 1 

l *o ( 1 ' ’ ’ V.'V B n r i <e 2 

1=0 

1=0 



"l 

°2 


n, , n , 


and 


+ (l-oO ^ J <6' o (i,)> B n if i <e i > B n 2 ,j <0 Z > 
i=0 ] =0 

= a Q<6°) + (l-«) Q< <5 ' 0 ) 
o 

1-Q (6 01 ) = l-« Q<<5°) - Q(6 o > 

o ° 

= a<l-GK<5°>> + <l-a><l-Q <6 o> ) 
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GK^ 01 ) = min « min Q(6 a > , min < 1 — Q < <5°* > > > 

° ° ©^©j+d 0 J 


= min -I min (a Q<6°) + <l-a> Q<6' )>, 

L® i~© 2 + d ° 


min (ot(l-Q<6°>) + ( 1-cO ( 1 -Q<6' > >) j- 

e z >e^d 0 J 

Since min <f(x) + g(x)> > min f(x> + min g(x) for any set B, we 
xeB xeB xeB 


have 


Q(<5° ( ) > min -lot 

° l e l 


min Q(<5° ) + (1-ot) min Q<6') . 
>0 £ + d ° ©^©2+d 


a min <1-Q<6°)> + <l-a> min (1-Q(6 

© 2 >© j+d ° © 2 >©j+d 

> cx Q(6°) + <l-oO Q(6' ) 
o ° 


* ))>l 

° J 


max Q(6> . 


n .n 

6el> 

n j , 

Hence Q<6°*> = max Q<6> . which implies 6* € S> Q .V ccCO.n. 
° n, .n- 

6e2> 


n, , n 


Lemma !5* 3. 2 


• Let 6 « S> l ’ 2 and define 6 by 


6< i , j ) = 1 -«5 C n j 


i , n 2 -)>. i = 0.1 n r * = 0,1 n 2 

. ~ "l ,n 2 


n, | Ha . £ <■% 1 ^ 

Then 6 <= S> 1 2 i f and only if <5 « *> 0 
o 

n l n 2 

Proof i Q<6> = ^ J 6(i, J> B n 1 ,i <0 l > B r> 2 , j 2 

” i =0 j = 0 


n l n 2 


i i — >(? JO"-’’ 


n.-i n 2 _ * 

> 1 0 2 <1 “ e 2 > 


i=0 j=0 
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min Q(6) 
© 1 >e 2 +d 


Simi larly , 

e 


n i n 2 


i i >( ni )( " 2 H-V 1 ' 1 

1=0 j =0 n r l 1 v» J 


1 n 2 _) 
<i-© 2 > 


n l n 2 


1 1 *<v-2-j> [ ni ) ("*] 

= n i — n ^ ) 


n, - 1 


l =0 j = 0 


n -k 

<i-e z ) ] e z 


n i n 2 


J y <5(n.-i,n -j> B o . (1-e.) B (I-©-) 

la Ll l c. ru , i 1 , ) 2 

=n i-n 1 L 


I ==0 ]=0 

n l n 2 


7 y <l-6(n.-i B <1-©.) B <l-e„> 

L L 1 2 n, , l 1 n 7 , j 2 

i = 0 ) =0 


min Q<6) 


1-e^l-Gj+d 


min 


n l n 2 


l 2 U-Sj) 

i-e z >i-e 1+ d ,t 0 jf 0 i 


B :<l'0o> 
n £ , ] 2 


n l n 2 


= min J J <!-*“•*>> Bn,./ 6 !* V/V 

®2 a0 l +d i =0 j=0 1 2 


min < 1 — Q <<5 > > 

e z >e } +d 


min <1-Q<«5>> = min Q<<5>. 

.iSj+d e i~ 0 2 +d 
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Hence 

5(6) = 5(6) 


and the result follows. B 

As an immediate consequence of above two lemmas we have 

n, ,n* 

Corollary 5# 3.1 t If <5 q € , then 

^ 1 

6°* < 1 . j > = ex 6 ( l , ] ) + < 1 -a X 1 -6 (n.-i.n,-))) e 3) 
o o 0 12 o 

V a e CO. n 


, n 


2 


Remark t Corollary 5.3.1 suggest that if minimax decision rule 6 q 

n r n 2 

is unique then 6 q e 2)^ 

Now, 6 e 3) 1 2 can be represented by a matrix of order 

(n j + 1 > x <n 2 + l> as follows : 

6 s <<S < i , j>) . i = 0.1 n r j = 0.1 n 2 


Let 


6 T . 

(6 ( ) , i ) ) , 

i ” 0 1 1 i • • ■ 

, ,nj , j = o.l... 

► • i n £ » 

1-6 s 

( 1 -6 ( i . j > ) . 

1 = 0 1 1 4 ■ • 

. , n^ . j = 0,1.. 

* * * 1 


~ T 

6 s IS . 


Lemma 5 


n l ,n 2 


.3.3 t Let 6 c » 1 • Then 6 q e 


n j « n ^ 


if and only if 


% n ? , n. 

6 e 3) 
o o 

Proof . L.t « 0 «J> n, '" ! ' Then 


min Q_ n 

e>e 7 +d 1 ’ Z 

12 "l n 2 

. min l p 0 <>.i> B n 2 ..‘^ > 

e i~ 6, 2 +d i = 0 J=0 
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Here n 2* n 2 1S indicated with Q for clarity. 


mi n Q <6 > 

e } >e z +d n l ' n 2 



n i 

CVJ 

C 


rm n h 

1 - 1 

l 

< 1-6 < i . j > ) 

e^e^d 

Lt 

- 1=0 

1=0 

0 



n 2 


min h 

i - j 

l 

< 1-6 < l , j > ) 


L i =0 

£j 

1=0 

0 


r v 1 

v 2 


mm 

1 - 1 

5 

< 1-6 < j . i>> 

© 2 >e 1+ d 

1=0 

iu 

1 = 0 

0 


f "1 

n 2 


min h 

1 - 1 

l 

6 o <i,l )) B n 

© 2 >©l+d 

1=0 

SmA 

1=0 


3 . \ v7 - / D 0 

Hj , i 1 , ) 2 


3 - VC? 0 7 U> 

, i 2 . ) 


? w 0 J 

nj , j 2 


■1 

-} 

<® i > r 

n 2 1 1 1 J 


min 

©^©j+d 


li - q <vj 
1 n 2 ,n l J 


Similarly. 


min 

©^©j+d 


1 - Q <<$ > 

n j , n^ o 


min Q n < 6 0 > 
©^©2+d n 2’ n l 


> Q <6 > = n i6) 

n l- n 2 ° Z' 1 n n ~ 

*0 1 ’ 2 if and only if <5 « 3 > 


n 2 ,n l 


Now using the fact that 6 € 
get the required result. ^ 


we 


Following Theorem gives three necessary 


conditions for a rule 


to be minimax. 


Theorem 5. 3. 1 * 
( i ) min 

©j£© 2 +d 


Let 6 

Q(tf 0 > • 


n. , n 

e 3 ) 
o o 


min 

e^e^d 


Z . Then 
<l-Q< 6 o >> 
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(ii> <5 o (l o’ , o > > 0 for some (l o ,) o > lm P lles that 6 o ( i o +1 ’ J o _1 > = 1 
<iii> For d > .5, > 0 for some ( i^, j o ^ implies in 

addition to (11), that 6 (i +1 , j ) = l and <5 (i ,j -1> = 1. 

o o o o o o 


Proof * <i> Let M = min Q(6 ) and M' = min (1-Q(<$ n >>. 

©^©2+d 0 © 2 >© 1 +d 

First suppose that M' < M. 

ki/ 

Let n— < c < 1 and consider the decision rule 6 defined by : 

M c 

<5 < i , } > = c 6 q < l , j ) , l = 0,1 nj, ) = 0,1 n 2 - 


Then 


n l n 2 


nun <1-Q<6 )> = min <l-c £ J 6i i , i >B <6j >B n <e 2 > > 

e 2 >e 1+ d W d ,t 0 j.o 1 2 


min 

© 2 >©j+d 


<l-c 


n l n 2 

J I <-l+6 o (i , j>+l) 

i = 0 j=0 


B 


( V B n. 


,< V > 


n l n 2 

min <l-c + c J J (1-6 0 <1,)>> 
e 2“ 0 l +d i=0 J =0 


B 


n, 


( V B n. 


<e 2>> 


= l-c+c min 


1 l 


<1-6 <i , j>> 
o 


B 


n, 


i 1 n. 


(© 2 >) 


= 1-c+cM' 
> M' 


(since M' < 1 ) • 
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min Q(6 ) = cM > M' . 
e 2 # 2 +d c 

n r n 

contradicting the assumption that 6 e X> 

o o 


Next, suppose M < M' . 

L e t < y < 1 , and consider the decision rule 6 * defined by 
M' 

6^(1,)) = y 6 <i,j> + (1-y) 6 U <i,)>, l = 0,1 , j = 0,1, 

where 6 u <i,j> = 1 . V i,j. Then 


min ( 1 -Q< 6 ^>> 




n l n Z 


min <1 - \ \ O' 6 q <i . j> + <l-r>> 


0 Z“ e i + d i=0 j =0 


B <«VB 
n j , l 1 n^ i 1 ^ 


n l n Z 

min <1 “ ^ J 

e 2 >©i+d i=0 , =0 


( -v <1-6 ( i , ) ) > + 1 > 


B < 0 ,>B t i 6 9 ^ 

nj , i 1 n 2 • 5 L 


= y M' > M 


QOS*") - J-M + (!-)-> > M <since M < ° 


e 2 *V d n.,n, 

, . +H _x X e T> J . Hence the 
Contradicting the assumption tha © Q 0 


result 


fol lows 


(ii) Let e > 0 and suppose o o '' 0 ,J o 


a a +i.i -i) < »• Let 
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• •li-:!!":))' 


and 


1 7 


l +1 

o 




Now consider the decision rule 6 defined as 


6 ( i , j ) =6 <i,j) 

o 


“ ( . 1 > +» , 

o o 


for Ci,)) * < i , ) ) , ( l +1 , | -1 ) 
o o o o 

for ( l , j ) = ( i , j > 
o o 


= <5 0 < 1 . J ) +7> 1 +1 ,j o -1 for (i,j) = <i o +1.j o ” 1> 
o ‘ 

where c > 0 is chosen such that 

0 < <5*<i , j ) < 1 and 0 < 6*<i +1 , j -1) < 1. 
o o o o 


Then 


i +1 n - l -1 ) -1 n_-j +1 

QC6*) = Q(6 q > + « ©j° (1 -©j> 1 © 2 <l-©2 > 

l n ?"jn 

- ^ ©j° a-Sj) 1 0 e 2 <i-© 2 > 2 

1 n i " ‘ ) 0 _1 n ? _) n 

= Q <6 o > + € 9° <i-dj) 1 ° e z ° (l-© 2 > 


w l a-e z )-u-e 1 )e z ) 


n,-i -1 j -1 


Q<6 > + c e. ci-e, > 


'1 o 


e. 


<i-e 2 > 


n 2 _) o 


CSj-^) 


Clearly , 


Q <6 > > Q<«5 o > 
and Q<<5*> < Q(<5 o > 


if 9 l > e 2 + d 
If 9 Z t ©j+d 


Therefore , 


mi n 

© 1 >© 2 +d 


Q(<5*> > min Q <<5 0 > 
e 2 >0j+d 


and 
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min U-Q<6 )) > min (1-GK6 )) 

© 2 >©!+d 0 2 >©j+d ° 

which contradicts the assumption that 6 


2) 


n 1 * n 2 


Hence the 


result follows. 

( 111 ) Note that d > .5 implies that 


and 


© 2 > .5 for ©j > © 2 +d 


© 2 < .5 for © 2 > © 2 +d 


(5.3.1) 


Suppose 6 ( i +1 . ] ) < 1 for some (i ,j >. 

o o o o □ 

For £ > 0, consider the decision rule 6 defined as : 


6 (i,j) = 6 q ( i . 1 ) 


= 6 Q (i . )) - « 


6 ( l . j ) + ^ 
o 


{[;;][ :: )) 
[ :: )) 


for < i . j >^< i o . ) Q > . < i o +1 • 3 0 > 


for ( i . ) ) = < i Q . ) D > 


for (i,)> = <x +1. J 0 > 


where s > 0 is chosen such that <5 is a valid decision rule. 


l +1 n.-i -1 *o 

Q(6*> = + * e ° u ' e j > e z n ' e 2 > 


n r’o 


i 

- £ ©^(l-Oj) 


1q ©* 0 <l-© 2 > 

n, - i -1 J 


n 2" j o 


1 *° ‘ e ^ u -©,)" 2 , 0 < 2 e ,- i > 


= Q(6 o ) + £ (1 'V " X '" L 

using (5.3.1), it follows that 

Q (<5*) > Q<«5 > ‘f e i - e 2 +d 


and 


Q(6 


) < Q<6 > lf e ? ~ e i +d 
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Hence , 


min Q (S ) > min Q(<$ ) 


W d 


9j>0 z +d 


and min (1-Q (6 >) > min (1-Q(6 >) 

& z >e J +d & 2 >e 1 +d ° 

n, ,n ? 

which contradicts the assumption that 6 e 3) . Thus 

o o 

<5 (i +1 , j ) = 1 
o o o 

6 (i , j > > 0 — > 6 <i ,j -1) = 1 follows similarly. m 
ooo ooo ■ 


As a consequence of the above Theorem, we have 

n ] * n 2 

Corollary 5. 3. 2 : ( i > Suppose that <5 q € 2)^ and suppose n^ 

n l ' n 2 

and n 2 are both positive odd integers. Then c 2> q implies 

that 


n 

2 


n, +1 


+ i , 


n^-l 


-0- 


1 for l > 0 


and 


r 1 

>o l 2 


■n, -1 


i . 


n 2 + l 


+ jj = 0 for l > 0 


(5.3.2) 


n - « n r 


( i i ) Suppose that d > .5 and € 3)^ Let n ^ and be both 

n l * n 2 

positive odd integers. Then c 2) q implies that 


n, +1 


•oR 


+ i . 


n 2 _1 


-0- 


= 1 V i > 0, j > 0 


and 


; oR 


n, -1 


n ? +l 

- i , -4— + ) 




V i > 0. j > 0. 


(5.3.3) 
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n l ’ n ? 

(ill) Suppose that d > .5 and 6 e 2 >. 

o 1 

n } * n £ 

be even. Then 6 e 2 > implies that 

o o 


Let n^ be odd and n^ 


• r 1 

>0 l 2 


n. +1 


2 + 1 ’ 2 


n, -1 


H 


ol 2 -..-+.1=0 


- o - 
-)■ 


V i > 0. ] > 0 


V i > 0. j > 0. 


<5.3.4) 


n. , n„ 

<iv) Suppose that d > .5 and <5 q e 3)^ . Let nj and n^ be both 

positive even integers. Then 
n, n, 

= .5 


3 ) 

-0 = 

^2 

2 


R 

■f 

i . 

r 


n 2 

l 2 

• 

2 

R 

+ 

i . 

r "> 



l 2 


i « 

r n i 


n 2 

l 2 

* 

2 


= 1 


)■ 


= 0 


+ .] = i 


V i > 1 

v i > i 

1 v i > 1. j > i 

V i > 1 

V ) > 1 


and 


R - 


i . -J + j 


j = 0 V i > 1', ] i 


<5.3.5) 


n l’ n 2 


<v) Suppose that d > .5 and <5 Q e 3> 0 • Then 

> . 
o 


min Q<6 > = min Q<6 n )) 
ej>0 2 +d e i =0 2 +d 


and 


mi n 

e z > 9 j+d 


(1-Q<6*>> > m * n 


®2 =S l +d 



1>0 


Proof * ( 1 > Suppose 


Then 


r v 1 

n 2 _1 1 

= £, 0 < e < 



l 2 

’ 2 

J 

1 


n -1 

n 2 + l , 

1 = ‘^ol n i - 

n r l 

„ n 2 +1 l 

L 2 

' 2 

J 

2 

’ n 2 ' 2 J 


= 1-6 


ol 2 
= 1 ~£ . 


r V 1 V 1 i 
l 2 • ~2~ J 


Now £ < 1, implies that 


r n i +1 l v 1 t 

6 o[t- • 4-] < »• 


and 


f n l ^ n^+l * 

6 o(— • -T-) > 0 

which contradicts (ii) of Theorem 5.3.1. Thus 


f V 1 "2' 1 1 

’ol 2 ' 2 J 


and 


r "r 1 n 2 +1 i 

6 o(— • — J * 0 

Now using <ii) of Theorem 5.3.1, we get 


r n +1 n -1 

6 - + i , f - l 

o ^ z z 


)■ 


1 for l > 0 


n r l 


n ? + l n 

- j , _i — + i J = 0 for i £ 0 


ol 2 2 

( l i ) Proceeding as for the proof (l), we have 

6 [ ' '~T~ ) ° 1 


o 2 


and 


. r V 1 V 1 1 

’□I -r~ • 2 J 


= 0 
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Now on using < 1 i i > of Theorem 5 . 3.1 
result. 

< 1 i i ) Suppose 


» we get the required 


6 r vi n 2 1 _ 

o[ 2 ’ T J " 


0 < c < 1 


Then 




1 - 

6 1 

[ n i - 

"r 1 

o 1 

2 

1 - 

<5 I 

r v 1 


o I 

L 2 

' 2 J 

1 ~£ 





n 


c < 1 , implies that 


<5 1 

r nj+1 


< 

1. 

o| 

„ 2 

• 2 J 

and 





<5 1 

r n J -1 


> 

n 

°| 

2 

' 2 J 

/ 

u 

which contradicts (iii> of Theorem 5.5.1. 

6 f 

. n^ + 1 

— l 


1 

°l 

2 

’ 2 J 


and 





6 f 

■ "I* 1 



o 

ol 

2 

’ 2 J 



Result follows from 

< l i i > 

of 

Theorem 5.3.1 

( iv) «5 q | 

' n l 

2 ’ 

%)■ 

1 

A f nj 

‘ 6 o[ n l ' T ' 

— > 

f n i n 2 

S o[~I ' 

) 

= .5 

and result follows 

from < i i i ) of Theorem 5. 

( v) Using < i i i > of 

Theorem 

5.3.1 and Lemma 

the required 

result 

*■ 





is an essentially complete 


n i | Ha 

Remark * Using the fact that 2)^ L 

class, we conclude that there exist a minimax rule satisfying 
(5.3.2) - (5.3.5). 

Note that the class of rules considered by Risko 

V 2 = { Vp 2 : 6p \ K7 - *z >} 

€ T = C(x,y) € IR 2 | X < jr<l+y>. y ^ 0), 


where 


y/(x) = | x 

0 


if x > 1 

if 0 < x < 1 , 

if x < 0 


satisfies <i) of Theorem 5.3.1. However, the following examples 

n n 

shows that rules in 2> R in general do not satisfy (li) and 

( 111 ) of Theorem 5.3.1. 


Example 5.3.1 * Let n } = 5. n £ = 4, ft l = ft z = 0.5. Then 


= 2 " 8 = 8 


whereas , 


Thus <5 


ft l ,ft z 


= 1 + 1 =2 
'ft,, ft 7 2 10 5 

does not satisfy (ii) of Theorem 5.3.1 


„ ( 1 . 0 ) = 4 + = 4 < 1 

* 1 ,{i Z 


Example 5.3.2 * Choose n } = 4, n £ = 10. = 1 , ft z 


= 3. Then 


and 


v ^ 0,8 ’ " 0,1 


(4,7) = 0.9 < 1. 


Hence (ii) of Theorem 5.3.1 is not satisfied. 
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The following two examples establish that decision rules in 
Risko's class in general do not satisfy (lii) of Theorem 5.3.1. 

Example 5.3.3 i Suppose = 15, n^ = 20, - ~ 1 , - 5. Then 

6 (3.1) - .35 

' 1 'l 


and 


32 


Vp 2 <4,1> m; - »•« < >• 


Thus, in this case (iii) of Theorem 5.3.1 is not satisfied. 


Example 5.3.4 l Let n^ = 2 , n^ = 4, P-^ = 2 ’ ^z = "^ en 

■ °' 5 

and 


« <2 * 2) = °* 85 < 1 


and hence (in) of Theorem 5.3.1 is not satisfied. 
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